-- Logs begin at Wed 2022-06-22 09:33:26 UTC, end at Wed 2022-06-22 10:48:12 UTC. -- Jun 22 10:06:13.850433 dv-cinder-847132-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 22 10:06:13.860633 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 22 10:06:13.862806 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 10:06:13 2022] *** Jun 22 10:06:13.862806 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 10:06:13.862806 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 10:06:13.862806 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: nodename: dv-cinder-847132-1-iscsi Jun 22 10:06:13.862806 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: machine: x86_64 Jun 22 10:06:13.862806 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: clock source: unix Jun 22 10:06:13.862806 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: pcre jit disabled Jun 22 10:06:13.862806 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: detected number of CPU cores: 4 Jun 22 10:06:13.862806 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: current working directory: / Jun 22 10:06:13.862806 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: detected binary path: /usr/bin/uwsgi-core Jun 22 10:06:13.863505 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: your processes number limit is 47680 Jun 22 10:06:13.863505 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: your memory page size is 4096 bytes Jun 22 10:06:13.863505 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: detected max file descriptor number: 2048 Jun 22 10:06:13.863505 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: lock engine: pthread robust mutexes Jun 22 10:06:13.863505 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: thunder lock: enabled Jun 22 10:06:13.863505 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 22 10:06:13.863505 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 10:06:13.906533 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: Python main interpreter initialized at 0x5569e89789c0 Jun 22 10:06:13.906533 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: python threads support enabled Jun 22 10:06:13.906533 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: your server socket listen backlog is limited to 100 connections Jun 22 10:06:13.906533 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: your mercy for graceful operations on workers is 90 seconds Jun 22 10:06:13.906890 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 10:06:13.906890 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: *** Operational MODE: preforking *** Jun 22 10:06:13.907182 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: *** uWSGI is running in multiple interpreter mode *** Jun 22 10:06:13.907182 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: spawned uWSGI master process (pid: 80150) Jun 22 10:06:13.907358 dv-cinder-847132-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 22 10:06:13.910540 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: spawned uWSGI worker 1 (pid: 80159, cores: 1) Jun 22 10:06:13.910540 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: spawned uWSGI worker 2 (pid: 80160, cores: 1) Jun 22 10:06:13.910540 dv-cinder-847132-1-iscsi devstack@keystone.service[80150]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 10:06:19.310201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:06:19.310201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: from cryptography.utils import int_from_bytes Jun 22 10:06:19.311097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:06:19.311097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: from cryptography.utils import int_from_bytes Jun 22 10:06:19.312327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:06:19.312327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: from cryptography.utils import int_from_bytes Jun 22 10:06:19.312789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:06:19.312789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: from cryptography.utils import int_from_bytes Jun 22 10:06:19.358425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:06:19.358640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:06:19.358839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] command line args: [] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:06:19.359088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:06:19.359285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ================================================================================ {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:06:19.359527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] admin_token = **** {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.359768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] config_dir = [] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.359901 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:06:19.359990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.360068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:06:19.360135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] config_source = [] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.360207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] command line args: [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:06:19.360268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] debug = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.360432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.360710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:06:19.360710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ================================================================================ {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:06:19.360837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.360903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] admin_token = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.360962 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.361169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] config_dir = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.361297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.361375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.361438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.361557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] config_source = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.361640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] list_limit = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.361703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] debug = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.361813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] log_config_append = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.361896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.361983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.362173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] log_dir = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.362267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.362330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.362399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] log_file = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.362567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.362660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.362775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.362856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] log_config_append = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] log_dir = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] log_file = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.363952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.364036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.364171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.364279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.364442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.364546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.364755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.364874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.364943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.365022 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.365085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.365146 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.365205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.365350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.365487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.365619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.365706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.365874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.366111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.366199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.366273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] publish_errors = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.366334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.366490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.366606 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.366733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.366811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.366912 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.367168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.367271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.367342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.367594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] standard_threads = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.367690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.367763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] publish_errors = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.367822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.367976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.368123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.368206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.368279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.368446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] use_journal = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.368526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.368599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] use_json = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.368698 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.368774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] use_stderr = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.368897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] use_syslog = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.368985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.369065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.369144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] standard_threads = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.369242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.369319 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.369466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.369555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.369635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.369721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.369804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] use_journal = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.369935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.370016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] use_json = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.370096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] use_stderr = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.370169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.370252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] use_syslog = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.370399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.370479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:06:19.370681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.370804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.370928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.371027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.371131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.371228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.371379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.371495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.371615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.371721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.371869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.372916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.373004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.373172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.373263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.373409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.373489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.373651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.373751 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.373892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.373985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.374203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.374286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.374452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.374585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.374745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.374823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.374940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.375035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.375184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.375264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.375417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.375497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.375667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.375767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.375916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.376004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.376163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.376252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.376391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.376479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.376616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.376712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.376842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.376929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.377078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.377181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.377317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.377406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.377551 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.377637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.377776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.377863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.378002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.378093 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.378228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.378323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.378468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.378568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.378728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.378818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.378953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.379034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.379179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.379258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.379406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.379509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.379637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.379717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.379862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.379942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.380092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.380285 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.380379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.380452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.380524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.380595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.380752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.380868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.380975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.381055 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.381201 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.381286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.381428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.381543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.381648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.381727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.381874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.381958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.382102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.382191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.382329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.382409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.382567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.382685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.382797 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.382903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.383002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.383116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.383215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.383312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.383439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.383569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.383685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.383800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.383884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.383995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.384102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.384195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.384336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.384429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.384547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.384624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.384799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.384954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.385034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.385156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.385263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.385345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.385442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.385522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.385676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.385762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.385903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.385985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.386156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.386240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.386385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.386476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.386625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.386703 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.386857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.386949 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.387091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.387173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.387319 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.387431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.387552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.387633 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.387795 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.387895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.388030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.388117 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.388258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.388358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.388490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.388578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.388720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.388800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.388952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.389035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.389181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.389266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.389410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.389489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.389667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.389747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.389900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.389985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.390133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.390214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.390362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.390449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.390617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.390700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.390849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.390946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.391078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.391157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.391304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.391381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.391528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.391608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.391754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.391852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.391981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.392071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.392205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.392287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.392433 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.392512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.392658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.392754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.392882 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.392962 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.393109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.393189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.393343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.393429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.393573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.393680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.393796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.393886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.394044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.394123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.394286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.394367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.394550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] auth.external = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.394638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.394768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.394862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.395059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.395141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.395285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.395365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.395512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] auth.password = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.395610 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.395737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] auth.token = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.395831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.external = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.395962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.396049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.396188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.396271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.396427 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.396522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.396651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.396731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.password = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.396891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.396972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.token = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.397124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.397212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.397346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.397432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.397575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] credential.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.397656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.397798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.397887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.398045 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.398164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.398284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.398373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.398518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.398613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.398759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.398841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.398985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.399065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.399229 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.399320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.399471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.399551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.399697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.399780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.399933 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.400021 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.400163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.400248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.400418 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.400498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.400665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.400765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.400896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.400978 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.401142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.401224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.401374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] federation.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.401469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.401605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.401688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.401835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.401916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.402070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.402163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.402298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.402380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.402571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.402668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.402804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.402916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.403047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.403128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.403276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.403374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.403501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.403641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.403768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.403892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.404020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.404145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.404272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.404390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.404478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.404567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.404648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.404735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.404887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.404965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.405092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.405173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.405404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.405578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.405718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.405801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.405962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.406049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.406194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.406276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.406424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.406553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.406732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.406814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.406957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.407036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.407183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.407267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.407422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.407503 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.407661 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.407741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.407886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.407966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.408111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.408507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.408649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.408730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.408888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.408976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.409127 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.409208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.409361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.409441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.409589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.409671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.409822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.409903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.410047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.410128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.410278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.410360 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.410530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.410614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.410755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.410834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.410988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.411069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.411208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.411288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.411438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.411518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.411673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.411755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.411899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.411978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.412141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.412233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.412362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.412443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.412587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.412668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.412819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.412900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.413043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.413125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.413272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.413352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.413503 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.413583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.413726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.413807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.413958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.414038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.414194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.414285 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.414434 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.414536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.414688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.414769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.414938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.415016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.415165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.415254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.415395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.415476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.415637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.415717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.415874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.415964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.416094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.416175 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.416322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.416402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.416544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.416625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.416780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.416861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.417007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.417095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.417238 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.417318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.417466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.417547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.417691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.417780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.417926 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.418007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.418150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.418230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.418375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.418464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.418630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.418714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.418861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.418942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.419095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.419199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.419316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.419397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.419539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.419628 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.419766 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.419857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.419995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.420076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.420225 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.420306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.420448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.420536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.420670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.420751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.420936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.421019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.421170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.421261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.421402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.421483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.421633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.421712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.421853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.421940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.422091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.422171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.422319 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.422399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.422572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.422669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.422806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.422887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.423033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.423113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.423270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.423363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.423500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.423581 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.423729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.423833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.423960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.424103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.424185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.424329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.424409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.424569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.424655 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.424801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.424883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.425030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.425110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] resource.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.425261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.425342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.425501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.425583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.425737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.425817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.425962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.426043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.426192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.426274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.426424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.426555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.426688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.426769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.426922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.427005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.427152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.427241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.427374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] role.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.427455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.427607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] role.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.427686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.427825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.427907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.428062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.428191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.428279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.428356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.428513 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.428603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.428742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] role.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.428823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.428979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.429060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] role.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.429200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.429279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.429444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.429534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.429682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.429762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.429910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.429997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.430147 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.430234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.430384 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.430466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.430650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.430731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.430888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.430981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.431170 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.431316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.431400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.431550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.431631 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.431798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.431882 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.432042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.432123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.432278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.432357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.432522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.432693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.432776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.432930 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.433011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.433178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.433269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.433423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.433505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.433654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.433744 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.433904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.434001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.434105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.434187 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.434353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.434438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.434640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.434726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.434879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.434961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.435109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.435189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.435336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.435421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.435561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.435642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.435787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] token.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.435868 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.436018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.436100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.436259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.436340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.436564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.436647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.436802 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.436883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.437030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.437117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.437265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] token.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.437356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.437497 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.437580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.437733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.437814 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.437966 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.438054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.438190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.438273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.438424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.438524 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.438680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.438761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.438920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.439003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.439162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.439244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.439385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.439467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.439625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.439708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.439856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.439937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.440126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.440207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.connection = **** {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.440387 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.440477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.440629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.440710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.440859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.440940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.441093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.441173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.441331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.441413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.441564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.441651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.connection = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.441796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.441886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.442032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.442130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.442269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.442350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.442519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.442603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.442770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.442864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.443000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.443082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.443244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.443325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.443475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.443563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.443715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.443797 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.443940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.444021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.444173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.444262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.444401 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.444481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.444556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:06:19.444629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.444861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.445102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.445327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.445561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.445789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:06:19.445954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:06:19.475731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.475933 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.476018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.476094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.476169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.476314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.484977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.485224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.512973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.513221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.513349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.513349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.660590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.661463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.708678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.708985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.710229 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.710417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.771446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.771737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.771871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.772070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.772195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.772283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.772349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.772459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.772561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.772726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.772940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.773152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.798308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.798582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.798778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.798903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.798989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.799066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.799155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.799233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.799351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.799465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.799596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.799731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.799828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.800008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.810761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.812579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.826703 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.826934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.827266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.827488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.827701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.827907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.828115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.830118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.830348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.830592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.830816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.831024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.831232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.831440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:06:19.845816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.846020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 10:06:19.846107 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.846373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 10:06:19.846867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.846988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.847132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 10:06:19.847501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 10:06:19.847595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.847758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.847851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.848031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.848121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.848262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.848407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.848494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.860147 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.860527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.860877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.861279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.861913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.862161 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.862451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.862758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.869888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.870977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.873156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.873430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.873706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.874001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.874256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.874427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.874547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.874717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.874987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.875133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.875219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.875401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.875527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.875738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.875864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.875961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.876041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.876252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.876520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.876771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.877033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.877292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.902996 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.903476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.904604 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.904880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.905078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.905374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.910762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.910890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.911154 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.911300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.911386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.911547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.918743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.918869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.918992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.919098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.923547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.923673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.923841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.923986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.924072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.924149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.924369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.924496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.924612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.924716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.924909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.925035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.925150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.925239 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.925437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.925562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.943999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.944269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.944789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.945063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.948821 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.949898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.952630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.953014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.953677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.954071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.958004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.959181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.961588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.962955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.965271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.965561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.965841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.966123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.966397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.966670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.966799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.966961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.967238 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.967512 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.967791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.968109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.985640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.985891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.986155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.986419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.987641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.987920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.988193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.988456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.994189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.995889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.996158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.996389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.998079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.998381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.999386 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:19.999663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:19.999939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.000212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.000490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.001613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.001890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.002183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.002558 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.002833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.013590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.013866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.014151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.014425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.016206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.016491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.016579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.016778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.016870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.017088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.017364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.019120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.019406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.019692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.034790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.038041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.038138 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.041313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.041407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.043037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.044648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.044765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.044923 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.045216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.046603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.048236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.048524 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.048816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.052556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.054126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.056398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.057341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.057620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.058007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.058098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.058276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.061435 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.061749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.062149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.062405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.067338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.067618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.067891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.071770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.072093 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.072378 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.075705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.075979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.076253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.076517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.076829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.077235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.077507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.077771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.078059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.078322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.078620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.078885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.079145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.079406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.080526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:06:20.080800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.081072 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.081341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.081609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.082008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.082269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.082599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.082872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.083146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.083415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.083683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.083962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.084256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:06:20.116795 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5569e89789c0 pid: 80160 (default app) Jun 22 10:06:20.120303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cb4e6-b650-4b51-b168-c9572486ba5b None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:20.120591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cb4e6-b650-4b51-b168-c9572486ba5b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:20.120861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cb4e6-b650-4b51-b168-c9572486ba5b None None] PATH_INFO: `/v3` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:20.122862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5569e89789c0 pid: 80159 (default app) Jun 22 10:06:20.126088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Wed Jun 22 10:06:20 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:27.956503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef07553-4bde-4bb4-911a-24e69a275ac4 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:27.957090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef07553-4bde-4bb4-911a-24e69a275ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:27.957090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef07553-4bde-4bb4-911a-24e69a275ac4 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:27.962799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:06:27.969298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:27.969944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:27.969944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:28.053879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: INFO dbcounter [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] Registered counter for database keystone Jun 22 10:06:28.080190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG oslo_db.sqlalchemy.engines [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:06:28.088093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writer thread running {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:06:28.266853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG passlib.handlers.bcrypt [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80160) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 10:06:28.267420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG passlib.handlers.bcrypt [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80160) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 10:06:28.326417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:28.328156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:28.463916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 10:06:28.638584 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef07553-4bde-4bb4-911a-24e69a275ac4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:28.710203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: INFO dbcounter [None req-1ef07553-4bde-4bb4-911a-24e69a275ac4 None None] Registered counter for database keystone Jun 22 10:06:28.730737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG oslo_db.sqlalchemy.engines [None req-1ef07553-4bde-4bb4-911a-24e69a275ac4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:06:28.737720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writer thread running {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:06:28.865351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef07553-4bde-4bb4-911a-24e69a275ac4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:28.870194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d3028-6112-4135-a03a-72115322f873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:28.870886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3028-6112-4135-a03a-72115322f873 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:28.871173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3028-6112-4135-a03a-72115322f873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:28.871450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3028-6112-4135-a03a-72115322f873 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:28.879830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d3028-6112-4135-a03a-72115322f873 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:28.932923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ae4d3028-6112-4135-a03a-72115322f873 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 10:06:28.933192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d3028-6112-4135-a03a-72115322f873 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:28.943960 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1324 bytes} [Wed Jun 22 10:06:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:06:28.950396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:28.965796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bd21d-06e6-44c4-beba-0b30fd0ba2f6 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:28.972112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4baf13-048e-415a-8930-3ebfe277a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:28.973341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4baf13-048e-415a-8930-3ebfe277a3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:28.973641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4baf13-048e-415a-8930-3ebfe277a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:28.973915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4baf13-048e-415a-8930-3ebfe277a3e1 admin admin] PATH_INFO: `/v3/projects/5250969aacd849649f4438fde7d1550d` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:28.978293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4baf13-048e-415a-8930-3ebfe277a3e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=5250969aacd849649f4438fde7d1550d)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:29.029555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dc4baf13-048e-415a-8930-3ebfe277a3e1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 10:06:29.029908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4baf13-048e-415a-8930-3ebfe277a3e1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:29.035080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 3/5] 10.222.0.66 () {56 vars in 1207 bytes} [Wed Jun 22 10:06:28 2022] GET /identity/v3/projects/5250969aacd849649f4438fde7d1550d => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:31.099428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c264-80e1-41f2-92cf-1d911bebf8f8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:31.099947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c264-80e1-41f2-92cf-1d911bebf8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:31.099947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c264-80e1-41f2-92cf-1d911bebf8f8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:31.104068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 3/6] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:31.109539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80bcf2-90c7-47ae-8dae-c12bf880c7c1 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:31.109961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80bcf2-90c7-47ae-8dae-c12bf880c7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:31.110053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80bcf2-90c7-47ae-8dae-c12bf880c7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:31.129406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0f80bcf2-90c7-47ae-8dae-c12bf880c7c1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:31.130998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0f80bcf2-90c7-47ae-8dae-c12bf880c7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:31.139690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 10:06:31.163059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c264-80e1-41f2-92cf-1d911bebf8f8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:31.176419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c264-80e1-41f2-92cf-1d911bebf8f8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:31.181312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbb313-be86-4729-8186-282c32b2ed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:31.181987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbb313-be86-4729-8186-282c32b2ed3a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:31.182281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbb313-be86-4729-8186-282c32b2ed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:31.182567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbb313-be86-4729-8186-282c32b2ed3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:31.190939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbb313-be86-4729-8186-282c32b2ed3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:31.192857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbb313-be86-4729-8186-282c32b2ed3a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:31.202223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1324 bytes} [Wed Jun 22 10:06:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:06:31.208254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80bcf2-90c7-47ae-8dae-c12bf880c7c1 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:31.217996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80bcf2-90c7-47ae-8dae-c12bf880c7c1 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:31.223752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fb9d5-8777-4e6e-91fe-349c5ee039ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:31.224632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb9d5-8777-4e6e-91fe-349c5ee039ee admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:31.224915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb9d5-8777-4e6e-91fe-349c5ee039ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:31.225189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb9d5-8777-4e6e-91fe-349c5ee039ee admin admin] PATH_INFO: `/v3/users/24f043f060e24197b7146fc46f2ee305` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:31.226760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fb9d5-8777-4e6e-91fe-349c5ee039ee admin admin] RBAC: Authorizing `identity:get_user(user_id=24f043f060e24197b7146fc46f2ee305)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:31.228617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fb9d5-8777-4e6e-91fe-349c5ee039ee admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:31.230198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 5/9] 10.222.0.66 () {56 vars in 1198 bytes} [Wed Jun 22 10:06:31 2022] GET /identity/v3/users/24f043f060e24197b7146fc46f2ee305 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:33.392679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0c15-1134-4207-93b2-319e993fb6ae None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:33.393209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0c15-1134-4207-93b2-319e993fb6ae None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:33.393209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0c15-1134-4207-93b2-319e993fb6ae None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:33.394700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:06:33.399903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ee14-0185-4166-9fa1-26bf8ad7b236 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:33.400330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ee14-0185-4166-9fa1-26bf8ad7b236 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:33.400467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ee14-0185-4166-9fa1-26bf8ad7b236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:33.417776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-eac7ee14-0185-4166-9fa1-26bf8ad7b236 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:33.418986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-eac7ee14-0185-4166-9fa1-26bf8ad7b236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:33.504427 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 6/11] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:33.528106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec0c15-1134-4207-93b2-319e993fb6ae None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:33.683302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec0c15-1134-4207-93b2-319e993fb6ae None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:33.718845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93400dfe-12d2-407a-b449-e2d9e3ef2925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:33.719652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93400dfe-12d2-407a-b449-e2d9e3ef2925 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:33.719934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93400dfe-12d2-407a-b449-e2d9e3ef2925 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:33.720210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93400dfe-12d2-407a-b449-e2d9e3ef2925 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:33.732099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93400dfe-12d2-407a-b449-e2d9e3ef2925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-93400dfe-12d2-407a-b449-e2d9e3ef2925 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:33.743440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:33.744383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:33.745202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 6/12] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:06:33.750885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7ee14-0185-4166-9fa1-26bf8ad7b236 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:33.776935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:33.853658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3875c-12f4-4dbf-9578-8f21fa176306 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:33.853950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3875c-12f4-4dbf-9578-8f21fa176306 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:33.854276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3875c-12f4-4dbf-9578-8f21fa176306 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:33.855684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 7/13] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:33.859839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7ee14-0185-4166-9fa1-26bf8ad7b236 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:33.860884 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdf0d-9588-448b-bfb5-51fcea19064e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:33.861180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdf0d-9588-448b-bfb5-51fcea19064e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:33.861462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdf0d-9588-448b-bfb5-51fcea19064e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:33.877362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG passlib.handlers.bcrypt [None req-237bdf0d-9588-448b-bfb5-51fcea19064e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80159) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 10:06:33.877772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG passlib.handlers.bcrypt [None req-237bdf0d-9588-448b-bfb5-51fcea19064e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80159) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 10:06:33.895952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5e183-4f1d-42ec-9741-c3c0bae0a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:33.896618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e183-4f1d-42ec-9741-c3c0bae0a835 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:33.896925 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e183-4f1d-42ec-9741-c3c0bae0a835 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:33.897206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e183-4f1d-42ec-9741-c3c0bae0a835 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:33.897993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5e183-4f1d-42ec-9741-c3c0bae0a835 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:33.898308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5e183-4f1d-42ec-9741-c3c0bae0a835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:33.899748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5e183-4f1d-42ec-9741-c3c0bae0a835 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:33.911971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 7/14] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:33.917496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5e183-4f1d-42ec-9741-c3c0bae0a835 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:33.923261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-237bdf0d-9588-448b-bfb5-51fcea19064e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:33.924846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-237bdf0d-9588-448b-bfb5-51fcea19064e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:33.969670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:34.006113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:34.013660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 8/15] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:34.027380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5e183-4f1d-42ec-9741-c3c0bae0a835 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:34.036773 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdf0d-9588-448b-bfb5-51fcea19064e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:34.063754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b0b57-f9dc-418f-b1c2-1f27d20047c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:34.064655 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b0b57-f9dc-418f-b1c2-1f27d20047c1 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.064940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b0b57-f9dc-418f-b1c2-1f27d20047c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.065209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b0b57-f9dc-418f-b1c2-1f27d20047c1 None admin] PATH_INFO: `/v3/users/24f043f060e24197b7146fc46f2ee305` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.066583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b0b57-f9dc-418f-b1c2-1f27d20047c1 None admin] RBAC: Authorizing `identity:get_user(user_id=24f043f060e24197b7146fc46f2ee305)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:34.068130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b0b57-f9dc-418f-b1c2-1f27d20047c1 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:34.069810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 8/16] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:33 2022] GET /identity/v3/users/24f043f060e24197b7146fc46f2ee305 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:06:34.075214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b0b57-f9dc-418f-b1c2-1f27d20047c1 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:34.139113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdf0d-9588-448b-bfb5-51fcea19064e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:34.171649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182f78c-bc62-40c6-ac17-8e4202b2bee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:34.172543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182f78c-bc62-40c6-ac17-8e4202b2bee7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.172823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182f78c-bc62-40c6-ac17-8e4202b2bee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.173091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182f78c-bc62-40c6-ac17-8e4202b2bee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.175565 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b0b57-f9dc-418f-b1c2-1f27d20047c1 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:34.203753 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:34.210956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eb13f-066e-4d42-a6d6-b41a043519fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:34.211753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eb13f-066e-4d42-a6d6-b41a043519fb None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.212033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eb13f-066e-4d42-a6d6-b41a043519fb None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.212306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eb13f-066e-4d42-a6d6-b41a043519fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.213474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eb13f-066e-4d42-a6d6-b41a043519fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:34.214969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eb13f-066e-4d42-a6d6-b41a043519fb None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:34.216575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 9/17] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:34.222259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eb13f-066e-4d42-a6d6-b41a043519fb None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:34.242794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182f78c-bc62-40c6-ac17-8e4202b2bee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:34.243584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:34.244303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182f78c-bc62-40c6-ac17-8e4202b2bee7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:34.323402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eb13f-066e-4d42-a6d6-b41a043519fb None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:34.348819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 9/18] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:06:34.354793 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182f78c-bc62-40c6-ac17-8e4202b2bee7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:34.366543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cd75a-9f12-47ea-94e9-db77ea6b8741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:34.367217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd75a-9f12-47ea-94e9-db77ea6b8741 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.367499 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd75a-9f12-47ea-94e9-db77ea6b8741 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.367775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd75a-9f12-47ea-94e9-db77ea6b8741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.368625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cd75a-9f12-47ea-94e9-db77ea6b8741 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.domain.id=default, user.id=24f043f060e24197b7146fc46f2ee305) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:34.368999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cd75a-9f12-47ea-94e9-db77ea6b8741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:34.370428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cd75a-9f12-47ea-94e9-db77ea6b8741 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:34.377342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 10/19] 10.222.0.66 () {56 vars in 1322 bytes} [Wed Jun 22 10:06:34 2022] GET /identity/v3/role_assignments?user.id=24f043f060e24197b7146fc46f2ee305&scope.domain.id=default&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:06:34.418521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:34.463809 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182f78c-bc62-40c6-ac17-8e4202b2bee7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:34.499828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f2dd1-f553-40be-aded-360995f024d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:34.500534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f2dd1-f553-40be-aded-360995f024d6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.500817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f2dd1-f553-40be-aded-360995f024d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.501090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f2dd1-f553-40be-aded-360995f024d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.521119 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f2dd1-f553-40be-aded-360995f024d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:34.522612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f2dd1-f553-40be-aded-360995f024d6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8a2f2dd1-f553-40be-aded-360995f024d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:34.541593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:34.542622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:34.543445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:34.543445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:34.543445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:34.543445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:34.543445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 10/20] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:34.548647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cd75a-9f12-47ea-94e9-db77ea6b8741 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:34.638034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:34.657806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cd75a-9f12-47ea-94e9-db77ea6b8741 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:34.692463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f352e-cb47-43da-8946-5d59761fd450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:34.693138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f352e-cb47-43da-8946-5d59761fd450 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.693422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f352e-cb47-43da-8946-5d59761fd450 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.693704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f352e-cb47-43da-8946-5d59761fd450 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.694433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f352e-cb47-43da-8946-5d59761fd450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:34.694777 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f352e-cb47-43da-8946-5d59761fd450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:34.696255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f352e-cb47-43da-8946-5d59761fd450 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:34.713499 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 11/21] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:36.624815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012960e8-2675-4568-bbf8-c862e35c063b None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:36.625318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012960e8-2675-4568-bbf8-c862e35c063b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:36.625486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012960e8-2675-4568-bbf8-c862e35c063b None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:36.626779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 11/22] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:36.631947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf806c1-12a6-4cd5-9c77-4d8036c776c2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:36.632737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf806c1-12a6-4cd5-9c77-4d8036c776c2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:36.633212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf806c1-12a6-4cd5-9c77-4d8036c776c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:36.659653 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-1cf806c1-12a6-4cd5-9c77-4d8036c776c2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:36.660861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1cf806c1-12a6-4cd5-9c77-4d8036c776c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:36.755951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:36.800207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012960e8-2675-4568-bbf8-c862e35c063b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:36.938434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012960e8-2675-4568-bbf8-c862e35c063b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:36.956415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:36.981706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5b8f-3ade-47ec-8504-e9b68dd0f974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:36.982819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5b8f-3ade-47ec-8504-e9b68dd0f974 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:36.983303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5b8f-3ade-47ec-8504-e9b68dd0f974 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:36.983743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5b8f-3ade-47ec-8504-e9b68dd0f974 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.000348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a5b8f-3ade-47ec-8504-e9b68dd0f974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a20a5b8f-3ade-47ec-8504-e9b68dd0f974 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:37.008548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:37.009696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:37.014765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:37.016985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 12/24] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:06:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:37.023660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf806c1-12a6-4cd5-9c77-4d8036c776c2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:37.132606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:37.165840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf806c1-12a6-4cd5-9c77-4d8036c776c2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:37.211098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543e358-d9cc-4318-8bea-702d4b00b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:37.211720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543e358-d9cc-4318-8bea-702d4b00b154 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.212004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543e358-d9cc-4318-8bea-702d4b00b154 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.212279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543e358-d9cc-4318-8bea-702d4b00b154 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.213066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543e358-d9cc-4318-8bea-702d4b00b154 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:37.213375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543e358-d9cc-4318-8bea-702d4b00b154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:37.214836 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543e358-d9cc-4318-8bea-702d4b00b154 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:37.228700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 13/25] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:37.234562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5b8f-3ade-47ec-8504-e9b68dd0f974 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:37.376374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5b8f-3ade-47ec-8504-e9b68dd0f974 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:37.422542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec34fc-b595-4f2d-a941-cbde4cee14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:37.423894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec34fc-b595-4f2d-a941-cbde4cee14dd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.424431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec34fc-b595-4f2d-a941-cbde4cee14dd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.424911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec34fc-b595-4f2d-a941-cbde4cee14dd None admin] PATH_INFO: `/v3/users/24f043f060e24197b7146fc46f2ee305` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.427222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec34fc-b595-4f2d-a941-cbde4cee14dd None admin] RBAC: Authorizing `identity:get_user(user_id=24f043f060e24197b7146fc46f2ee305)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:37.429167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec34fc-b595-4f2d-a941-cbde4cee14dd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:37.431456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 13/26] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:37 2022] GET /identity/v3/users/24f043f060e24197b7146fc46f2ee305 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:37.437484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543e358-d9cc-4318-8bea-702d4b00b154 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:37.482735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d0f5d-93d4-4b3d-8f6c-98011b7a13de None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.483396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d0f5d-93d4-4b3d-8f6c-98011b7a13de None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.483881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d0f5d-93d4-4b3d-8f6c-98011b7a13de None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.485556 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 14/27] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:06:37.491440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d068f-db56-4c29-9637-e5b556e20ce9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.492038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d068f-db56-4c29-9637-e5b556e20ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.492510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d068f-db56-4c29-9637-e5b556e20ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.521862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fd8d068f-db56-4c29-9637-e5b556e20ce9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:37.526081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fd8d068f-db56-4c29-9637-e5b556e20ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:37.579006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:37.622478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 15/28] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:06:37.624033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20cf7a-d92a-4aa8-8cc9-c4ab52349063 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.624375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20cf7a-d92a-4aa8-8cc9-c4ab52349063 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.624660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20cf7a-d92a-4aa8-8cc9-c4ab52349063 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.626006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 16/29] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:37.632652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002b1e8-7e19-4951-a24f-8a4d01d5fac9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.632946 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002b1e8-7e19-4951-a24f-8a4d01d5fac9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.633230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002b1e8-7e19-4951-a24f-8a4d01d5fac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.662590 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a002b1e8-7e19-4951-a24f-8a4d01d5fac9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:37.664135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a002b1e8-7e19-4951-a24f-8a4d01d5fac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:37.674757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543e358-d9cc-4318-8bea-702d4b00b154 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:37.710049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2118ec-1084-4f26-b7b9-bc8599630852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:37.711128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2118ec-1084-4f26-b7b9-bc8599630852 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.711554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2118ec-1084-4f26-b7b9-bc8599630852 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.712000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2118ec-1084-4f26-b7b9-bc8599630852 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.713363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2118ec-1084-4f26-b7b9-bc8599630852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:37.715014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2118ec-1084-4f26-b7b9-bc8599630852 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:37.721547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 14/30] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:37.723227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ce6d-3d26-46bc-ae52-547d4db142dc None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.726428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ce6d-3d26-46bc-ae52-547d4db142dc None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.726428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ce6d-3d26-46bc-ae52-547d4db142dc None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.729482 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 15/31] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:37.730475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6ce6d-3d26-46bc-ae52-547d4db142dc None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:37.735576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:37.747558 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 17/32] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:37.750050 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec712-9493-4419-91c3-bff7a0d2a877 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.750578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec712-9493-4419-91c3-bff7a0d2a877 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.751297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec712-9493-4419-91c3-bff7a0d2a877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.772016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-096ec712-9493-4419-91c3-bff7a0d2a877 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:37.774169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-096ec712-9493-4419-91c3-bff7a0d2a877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:37.868684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 18/33] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:37.871417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ec712-9493-4419-91c3-bff7a0d2a877 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:37.876058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6ce6d-3d26-46bc-ae52-547d4db142dc None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:37.924096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:37.935385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3786-b6d5-4b87-a722-c500dc62438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:37.936081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3786-b6d5-4b87-a722-c500dc62438b None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.936420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3786-b6d5-4b87-a722-c500dc62438b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.936705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3786-b6d5-4b87-a722-c500dc62438b None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.937854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c3786-b6d5-4b87-a722-c500dc62438b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:37.939603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c3786-b6d5-4b87-a722-c500dc62438b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:38.008591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ec712-9493-4419-91c3-bff7a0d2a877 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:38.045964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f7143-2673-4a65-ab92-a2fc6319ba89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:38.047228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7143-2673-4a65-ab92-a2fc6319ba89 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:38.047720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7143-2673-4a65-ab92-a2fc6319ba89 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:38.048190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7143-2673-4a65-ab92-a2fc6319ba89 None admin] PATH_INFO: `/v3/domains/default/users/24f043f060e24197b7146fc46f2ee305/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:38.050534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f7143-2673-4a65-ab92-a2fc6319ba89 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=24f043f060e24197b7146fc46f2ee305, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:38.052383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f7143-2673-4a65-ab92-a2fc6319ba89 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:38.076919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 16/34] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Jun 22 10:06:37 2022] POST /identity/v3/roles => generated 219 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:38.083735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3786-b6d5-4b87-a722-c500dc62438b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:38.202791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 19/35] 10.222.0.66 () {58 vars in 1361 bytes} [Wed Jun 22 10:06:37 2022] PUT /identity/v3/domains/default/users/24f043f060e24197b7146fc46f2ee305/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:06:38.204469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f7143-2673-4a65-ab92-a2fc6319ba89 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:38.294988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:38.325724 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:38.334664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f7143-2673-4a65-ab92-a2fc6319ba89 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:38.376231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693b77c-851a-4c2d-bb3b-e20dee614efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:38.377426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b77c-851a-4c2d-bb3b-e20dee614efa None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:38.377962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b77c-851a-4c2d-bb3b-e20dee614efa None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:38.378438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b77c-851a-4c2d-bb3b-e20dee614efa None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:38.379554 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693b77c-851a-4c2d-bb3b-e20dee614efa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:38.381604 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693b77c-851a-4c2d-bb3b-e20dee614efa None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:38.404704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 20/36] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Jun 22 10:06:38 2022] POST /identity/v3/roles => generated 225 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:38.415409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3786-b6d5-4b87-a722-c500dc62438b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:38.461322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578897b-893d-4b3f-821f-7e65a38f2782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:38.462381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578897b-893d-4b3f-821f-7e65a38f2782 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:38.462826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578897b-893d-4b3f-821f-7e65a38f2782 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:38.463117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578897b-893d-4b3f-821f-7e65a38f2782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:38.479334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578897b-893d-4b3f-821f-7e65a38f2782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:38.481088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578897b-893d-4b3f-821f-7e65a38f2782 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-2578897b-893d-4b3f-821f-7e65a38f2782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:38.511244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:38.512148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:38.512953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:38.512953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:38.512953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:38.512953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:06:38.513194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 17/37] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:38.519344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693b77c-851a-4c2d-bb3b-e20dee614efa None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:38.534139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d075cd-717f-4de4-922f-a00d7292a700 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:38.534554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d075cd-717f-4de4-922f-a00d7292a700 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:38.534835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d075cd-717f-4de4-922f-a00d7292a700 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:38.536251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 18/38] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:38.542722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c6d45-3fd4-4617-949a-60a5a86720c4 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:38.543004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c6d45-3fd4-4617-949a-60a5a86720c4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:38.543289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c6d45-3fd4-4617-949a-60a5a86720c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:38.569760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d44c6d45-3fd4-4617-949a-60a5a86720c4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:38.571297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d44c6d45-3fd4-4617-949a-60a5a86720c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:38.678633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 19/39] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:38.683168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693b77c-851a-4c2d-bb3b-e20dee614efa None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:38.702170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c6d45-3fd4-4617-949a-60a5a86720c4 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:38.719158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736f66a-dd71-4462-aa0d-dcf2b0d7c29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:38.719823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736f66a-dd71-4462-aa0d-dcf2b0d7c29a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:38.720110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736f66a-dd71-4462-aa0d-dcf2b0d7c29a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:38.720389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736f66a-dd71-4462-aa0d-dcf2b0d7c29a None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:38.721132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736f66a-dd71-4462-aa0d-dcf2b0d7c29a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:38.721442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736f66a-dd71-4462-aa0d-dcf2b0d7c29a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:38.722870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736f66a-dd71-4462-aa0d-dcf2b0d7c29a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:38.741961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 21/40] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:38.747715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736f66a-dd71-4462-aa0d-dcf2b0d7c29a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:38.753939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:38.766022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:38.818247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c6d45-3fd4-4617-949a-60a5a86720c4 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:38.855997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc437768-cee6-43ec-b414-9534cc1fda22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:38.857081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437768-cee6-43ec-b414-9534cc1fda22 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:38.857562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437768-cee6-43ec-b414-9534cc1fda22 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:38.858080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437768-cee6-43ec-b414-9534cc1fda22 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:38.859075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc437768-cee6-43ec-b414-9534cc1fda22 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:38.860694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc437768-cee6-43ec-b414-9534cc1fda22 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:38.864379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736f66a-dd71-4462-aa0d-dcf2b0d7c29a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:38.878328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Jun 22 10:06:38 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:06:38.884282 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caaad0-a219-4c90-890f-03384d114f18 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:38.884791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caaad0-a219-4c90-890f-03384d114f18 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:38.885215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caaad0-a219-4c90-890f-03384d114f18 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:38.887156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 21/42] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:38.893310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec1eaf-e7f5-4914-acb2-0562fdbd8f34 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:38.893870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec1eaf-e7f5-4914-acb2-0562fdbd8f34 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:38.894159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec1eaf-e7f5-4914-acb2-0562fdbd8f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:38.908723 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c3385-c741-4eb6-a370-f07542b5c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:38.909806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c3385-c741-4eb6-a370-f07542b5c776 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:38.910287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c3385-c741-4eb6-a370-f07542b5c776 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:38.910824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c3385-c741-4eb6-a370-f07542b5c776 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:38.911789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c3385-c741-4eb6-a370-f07542b5c776 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:38.913012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-4cec1eaf-e7f5-4914-acb2-0562fdbd8f34 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:38.913911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c3385-c741-4eb6-a370-f07542b5c776 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:38.914260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4cec1eaf-e7f5-4914-acb2-0562fdbd8f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:38.955234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 22/43] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:06:38 2022] POST /identity/v3/projects => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:39.000569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 22/44] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:06:39.028805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c3385-c741-4eb6-a370-f07542b5c776 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:39.109427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:39.161704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c3385-c741-4eb6-a370-f07542b5c776 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:39.199743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf918e1-e2c5-4013-a61d-470e3cc1c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:39.200608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf918e1-e2c5-4013-a61d-470e3cc1c0fa None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:39.200899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf918e1-e2c5-4013-a61d-470e3cc1c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:39.201178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf918e1-e2c5-4013-a61d-470e3cc1c0fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:39.202400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf918e1-e2c5-4013-a61d-470e3cc1c0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:39.203927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf918e1-e2c5-4013-a61d-470e3cc1c0fa None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:39.205609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 23/45] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:39.211274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec1eaf-e7f5-4914-acb2-0562fdbd8f34 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:39.249722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:39.437624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec1eaf-e7f5-4914-acb2-0562fdbd8f34 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:39.473317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacad3f-01ee-4bb4-8772-5167be784c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:39.474012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacad3f-01ee-4bb4-8772-5167be784c5e None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:39.474276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacad3f-01ee-4bb4-8772-5167be784c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:39.474577 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacad3f-01ee-4bb4-8772-5167be784c5e None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:39.475300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacad3f-01ee-4bb4-8772-5167be784c5e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:39.476760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacad3f-01ee-4bb4-8772-5167be784c5e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:39.504934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:06:39 2022] POST /identity/v3/projects => generated 312 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:40.495088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93fece-03c8-4f46-9e78-c1769bd4d3cd None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:40.495608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93fece-03c8-4f46-9e78-c1769bd4d3cd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:40.495682 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93fece-03c8-4f46-9e78-c1769bd4d3cd None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:40.497168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 24/47] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:40.502697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce581-b38b-4098-b42f-f07af73ecf5a None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:40.503477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce581-b38b-4098-b42f-f07af73ecf5a None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:40.503952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce581-b38b-4098-b42f-f07af73ecf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:40.522115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e35ce581-b38b-4098-b42f-f07af73ecf5a None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:40.523645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e35ce581-b38b-4098-b42f-f07af73ecf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:40.595793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 24/48] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:40.621902 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93fece-03c8-4f46-9e78-c1769bd4d3cd None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:40.738822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93fece-03c8-4f46-9e78-c1769bd4d3cd None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:40.782271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc87da9-af32-4bb7-9089-1ded583e7ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:40.783603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87da9-af32-4bb7-9089-1ded583e7ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:40.784065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87da9-af32-4bb7-9089-1ded583e7ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:40.784530 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87da9-af32-4bb7-9089-1ded583e7ba2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:40.788096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:40.801309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc87da9-af32-4bb7-9089-1ded583e7ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3fc87da9-af32-4bb7-9089-1ded583e7ba2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:40.808965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:40.809892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:40.810846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 25/49] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:06:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:40.816095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ce581-b38b-4098-b42f-f07af73ecf5a None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:40.834852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:40.918351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ce581-b38b-4098-b42f-f07af73ecf5a None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:40.953590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7719e-379b-4dc7-911c-1c3c67c0c74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:40.954269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7719e-379b-4dc7-911c-1c3c67c0c74b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:40.954583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7719e-379b-4dc7-911c-1c3c67c0c74b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:40.954870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7719e-379b-4dc7-911c-1c3c67c0c74b None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:40.955627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7719e-379b-4dc7-911c-1c3c67c0c74b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:40.955939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7719e-379b-4dc7-911c-1c3c67c0c74b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:40.957311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7719e-379b-4dc7-911c-1c3c67c0c74b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:40.965890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 25/50] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:40.971565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc87da9-af32-4bb7-9089-1ded583e7ba2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:41.074548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc87da9-af32-4bb7-9089-1ded583e7ba2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:41.112517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccb035-a429-4092-9569-5d80017f04a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:41.113398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccb035-a429-4092-9569-5d80017f04a0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:41.113674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccb035-a429-4092-9569-5d80017f04a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:41.113941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccb035-a429-4092-9569-5d80017f04a0 None admin] PATH_INFO: `/v3/users/24f043f060e24197b7146fc46f2ee305` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:41.115300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccb035-a429-4092-9569-5d80017f04a0 None admin] RBAC: Authorizing `identity:get_user(user_id=24f043f060e24197b7146fc46f2ee305)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:41.116775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccb035-a429-4092-9569-5d80017f04a0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:41.118416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 26/51] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:40 2022] GET /identity/v3/users/24f043f060e24197b7146fc46f2ee305 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:41.125730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7719e-379b-4dc7-911c-1c3c67c0c74b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:41.229739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:41.250487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7719e-379b-4dc7-911c-1c3c67c0c74b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:41.284712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee95422-bcb2-4f3f-b6bd-0e226a366e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:41.285518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee95422-bcb2-4f3f-b6bd-0e226a366e70 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:41.285799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee95422-bcb2-4f3f-b6bd-0e226a366e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:41.286069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee95422-bcb2-4f3f-b6bd-0e226a366e70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:41.287281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee95422-bcb2-4f3f-b6bd-0e226a366e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:41.288734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee95422-bcb2-4f3f-b6bd-0e226a366e70 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:41.290328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 26/52] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:41.296248 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccb035-a429-4092-9569-5d80017f04a0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:41.358322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:41.402522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccb035-a429-4092-9569-5d80017f04a0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:41.445326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac315f4-192e-44a6-98c8-5296a6cb4866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:41.445989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac315f4-192e-44a6-98c8-5296a6cb4866 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:41.446270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac315f4-192e-44a6-98c8-5296a6cb4866 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:41.446572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac315f4-192e-44a6-98c8-5296a6cb4866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:41.447422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac315f4-192e-44a6-98c8-5296a6cb4866 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.domain.id=default, user.id=24f043f060e24197b7146fc46f2ee305) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:41.447732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac315f4-192e-44a6-98c8-5296a6cb4866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:41.449203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac315f4-192e-44a6-98c8-5296a6cb4866 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:41.457859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 27/53] 10.222.0.66 () {56 vars in 1322 bytes} [Wed Jun 22 10:06:41 2022] GET /identity/v3/role_assignments?user.id=24f043f060e24197b7146fc46f2ee305&scope.domain.id=default&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:41.552369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2913a-75fa-4f21-aab2-6e1727ebf07b None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:41.552939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2913a-75fa-4f21-aab2-6e1727ebf07b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:41.553492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2913a-75fa-4f21-aab2-6e1727ebf07b None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:41.556262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 27/54] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:41.564693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da16c08-22ed-45d4-aeb0-1bdbbca6ae5e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:41.565490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da16c08-22ed-45d4-aeb0-1bdbbca6ae5e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:41.565628 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da16c08-22ed-45d4-aeb0-1bdbbca6ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:41.690945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6da16c08-22ed-45d4-aeb0-1bdbbca6ae5e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:41.692478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6da16c08-22ed-45d4-aeb0-1bdbbca6ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:41.761832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 28/55] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:41.786132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2913a-75fa-4f21-aab2-6e1727ebf07b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:41.901448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2913a-75fa-4f21-aab2-6e1727ebf07b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:41.938065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0dc30-d888-45e0-8034-fb4f4dc8d8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:41.938889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0dc30-d888-45e0-8034-fb4f4dc8d8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:41.939171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0dc30-d888-45e0-8034-fb4f4dc8d8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:41.939447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0dc30-d888-45e0-8034-fb4f4dc8d8d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:41.940666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0dc30-d888-45e0-8034-fb4f4dc8d8d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:41.942125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0dc30-d888-45e0-8034-fb4f4dc8d8d9 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:41.943830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 28/56] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:41.949670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da16c08-22ed-45d4-aeb0-1bdbbca6ae5e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:42.006175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:42.050546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da16c08-22ed-45d4-aeb0-1bdbbca6ae5e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:42.087550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a54df-dd9c-4d0b-b012-5aae48ef02a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:42.088215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a54df-dd9c-4d0b-b012-5aae48ef02a2 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:42.088503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a54df-dd9c-4d0b-b012-5aae48ef02a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:42.088780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a54df-dd9c-4d0b-b012-5aae48ef02a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:42.089541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a54df-dd9c-4d0b-b012-5aae48ef02a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:42.091074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a54df-dd9c-4d0b-b012-5aae48ef02a2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:42.119298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 29/57] 10.222.0.66 () {60 vars in 1140 bytes} [Wed Jun 22 10:06:41 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:44.178990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fbf25-6552-455e-9466-93442c73a43a None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:44.179557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fbf25-6552-455e-9466-93442c73a43a None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:44.179557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fbf25-6552-455e-9466-93442c73a43a None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:44.181249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 29/58] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:44.187063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ec26c-5a71-4a53-a7e7-2ff44ce40f4d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:44.187508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ec26c-5a71-4a53-a7e7-2ff44ce40f4d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:44.187626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ec26c-5a71-4a53-a7e7-2ff44ce40f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:44.205837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ce6ec26c-5a71-4a53-a7e7-2ff44ce40f4d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:44.207094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ce6ec26c-5a71-4a53-a7e7-2ff44ce40f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:44.284667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 30/59] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:44.309381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fbf25-6552-455e-9466-93442c73a43a None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:44.330109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:44.424764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fbf25-6552-455e-9466-93442c73a43a None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:44.464968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c174b73-9531-4c49-986b-ab5f71b83cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:44.466007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174b73-9531-4c49-986b-ab5f71b83cae None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:44.466415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174b73-9531-4c49-986b-ab5f71b83cae None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:44.466869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174b73-9531-4c49-986b-ab5f71b83cae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:44.468888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c174b73-9531-4c49-986b-ab5f71b83cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:44.471285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c174b73-9531-4c49-986b-ab5f71b83cae None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:44.474010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 30/60] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:44.481526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ec26c-5a71-4a53-a7e7-2ff44ce40f4d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:44.529528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:44.597172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ec26c-5a71-4a53-a7e7-2ff44ce40f4d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:44.638562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fbbf3-edff-4ced-a922-49a9eb1b5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:44.639384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fbbf3-edff-4ced-a922-49a9eb1b5b69 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:44.639668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fbbf3-edff-4ced-a922-49a9eb1b5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:44.639943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fbbf3-edff-4ced-a922-49a9eb1b5b69 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:44.640834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fbbf3-edff-4ced-a922-49a9eb1b5b69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:44.644898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fbbf3-edff-4ced-a922-49a9eb1b5b69 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:44.674752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 31/61] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:06:44 2022] POST /identity/v3/users => generated 275 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:47.956393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad6af4-9235-475f-bca3-8c6eee78f64f None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:47.957420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad6af4-9235-475f-bca3-8c6eee78f64f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:47.957911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad6af4-9235-475f-bca3-8c6eee78f64f None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:47.959840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 31/62] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:47.965056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0cb14-b2c6-46d8-9e11-00b26970963e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:47.966001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0cb14-b2c6-46d8-9e11-00b26970963e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:47.966466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0cb14-b2c6-46d8-9e11-00b26970963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:47.991135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6ee0cb14-b2c6-46d8-9e11-00b26970963e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:47.992719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6ee0cb14-b2c6-46d8-9e11-00b26970963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:48.034284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70605e86-158f-42c6-affd-10a4fffdc3ce None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.034969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70605e86-158f-42c6-affd-10a4fffdc3ce None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.035433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70605e86-158f-42c6-affd-10a4fffdc3ce None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.036985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 32/63] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:48.042874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5bcc-c6e2-4134-93f1-eec2d3fbc962 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.043451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5bcc-c6e2-4134-93f1-eec2d3fbc962 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.043943 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5bcc-c6e2-4134-93f1-eec2d3fbc962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.072046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 32/64] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:06:48.082324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-95da5bcc-c6e2-4134-93f1-eec2d3fbc962 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:48.083832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-95da5bcc-c6e2-4134-93f1-eec2d3fbc962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:48.095436 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0cb14-b2c6-46d8-9e11-00b26970963e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:48.123272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:48.188506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 33/65] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:48.189950 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9054-7a0f-4b43-ab0d-f5f4f92367c2 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.198526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9054-7a0f-4b43-ab0d-f5f4f92367c2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.198526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9054-7a0f-4b43-ab0d-f5f4f92367c2 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.198526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 34/66] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:48.198526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49aac6-2737-4487-bf69-b3a43872d089 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.198526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49aac6-2737-4487-bf69-b3a43872d089 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.198931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49aac6-2737-4487-bf69-b3a43872d089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.227289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8f49aac6-2737-4487-bf69-b3a43872d089 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:48.230542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8f49aac6-2737-4487-bf69-b3a43872d089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:48.231500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0cb14-b2c6-46d8-9e11-00b26970963e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:48.240069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:48.282550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fffebd-65b8-4fa0-9d99-3dcf046a2988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:48.283926 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fffebd-65b8-4fa0-9d99-3dcf046a2988 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.284599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fffebd-65b8-4fa0-9d99-3dcf046a2988 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.285052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fffebd-65b8-4fa0-9d99-3dcf046a2988 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.300757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fffebd-65b8-4fa0-9d99-3dcf046a2988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:48.307625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 35/67] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-29fffebd-65b8-4fa0-9d99-3dcf046a2988 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:48.310245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:48.311198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:48.311982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:48.313896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 33/68] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:06:48.315497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49aac6-2737-4487-bf69-b3a43872d089 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:48.332468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fffebd-65b8-4fa0-9d99-3dcf046a2988 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:48.424364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:48.445413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fffebd-65b8-4fa0-9d99-3dcf046a2988 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:48.450942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49aac6-2737-4487-bf69-b3a43872d089 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:48.486422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7548ba-e46d-41bb-a45f-eca2eaf104a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:48.487181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7548ba-e46d-41bb-a45f-eca2eaf104a8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.487476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7548ba-e46d-41bb-a45f-eca2eaf104a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.487751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7548ba-e46d-41bb-a45f-eca2eaf104a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.488601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fc0d0-bcde-4e27-8ea7-b63bfff72b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:48.489433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc0d0-bcde-4e27-8ea7-b63bfff72b4f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.489743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc0d0-bcde-4e27-8ea7-b63bfff72b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.489996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc0d0-bcde-4e27-8ea7-b63bfff72b4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.498904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7548ba-e46d-41bb-a45f-eca2eaf104a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:48.502429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fc0d0-bcde-4e27-8ea7-b63bfff72b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3d7548ba-e46d-41bb-a45f-eca2eaf104a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:48.506808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:48.507692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:48.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:06:48.509078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7548ba-e46d-41bb-a45f-eca2eaf104a8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-fa6fc0d0-bcde-4e27-8ea7-b63bfff72b4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:48.516070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:48.517041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:06:48.517832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 36/70] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:06:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:48.518966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197be5-8587-4145-bd76-980ee6b2b7ff None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.519056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197be5-8587-4145-bd76-980ee6b2b7ff None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.519380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197be5-8587-4145-bd76-980ee6b2b7ff None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.525189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 37/71] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:48.525189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d197be5-8587-4145-bd76-980ee6b2b7ff None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:48.526771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:48.630029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7548ba-e46d-41bb-a45f-eca2eaf104a8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:48.646468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d197be5-8587-4145-bd76-980ee6b2b7ff None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:48.665635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19bc66-35dc-4d48-9ae4-299424a6030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:48.666315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19bc66-35dc-4d48-9ae4-299424a6030f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.666637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19bc66-35dc-4d48-9ae4-299424a6030f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.666919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19bc66-35dc-4d48-9ae4-299424a6030f None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.667678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19bc66-35dc-4d48-9ae4-299424a6030f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:48.667989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19bc66-35dc-4d48-9ae4-299424a6030f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:48.669401 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19bc66-35dc-4d48-9ae4-299424a6030f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:48.682303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 35/72] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:48.683332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386af9d9-05a3-4607-b1b3-4082dcade2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:48.684026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af9d9-05a3-4607-b1b3-4082dcade2aa None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.684300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af9d9-05a3-4607-b1b3-4082dcade2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.684579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af9d9-05a3-4607-b1b3-4082dcade2aa None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.685345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386af9d9-05a3-4607-b1b3-4082dcade2aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:48.685657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386af9d9-05a3-4607-b1b3-4082dcade2aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:48.687222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386af9d9-05a3-4607-b1b3-4082dcade2aa None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:48.687423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19bc66-35dc-4d48-9ae4-299424a6030f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:48.696048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:48.698839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 38/73] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:06:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:48.699954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041100c5-3363-4e88-b1af-97b932557031 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.700251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041100c5-3363-4e88-b1af-97b932557031 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.700530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041100c5-3363-4e88-b1af-97b932557031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.717010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-041100c5-3363-4e88-b1af-97b932557031 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:48.718310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-041100c5-3363-4e88-b1af-97b932557031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:48.780010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:48.789398 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 39/74] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:48.790792 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f2f5e-fb41-4737-ba37-b685a6e09217 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.791119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f2f5e-fb41-4737-ba37-b685a6e09217 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.791400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f2f5e-fb41-4737-ba37-b685a6e09217 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.794608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 40/75] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:48.794608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f2f5e-fb41-4737-ba37-b685a6e09217 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:48.794800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19bc66-35dc-4d48-9ae4-299424a6030f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:48.833400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e878-ce4a-446f-b09c-d7e2f5491d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:48.834084 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e878-ce4a-446f-b09c-d7e2f5491d8e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.834371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e878-ce4a-446f-b09c-d7e2f5491d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.834685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e878-ce4a-446f-b09c-d7e2f5491d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.835459 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5e878-ce4a-446f-b09c-d7e2f5491d8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:48.835777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5e878-ce4a-446f-b09c-d7e2f5491d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:48.837169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5e878-ce4a-446f-b09c-d7e2f5491d8e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:48.845408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 36/76] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:06:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:48.846253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e878-ce4a-446f-b09c-d7e2f5491d8e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:48.912280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f2f5e-fb41-4737-ba37-b685a6e09217 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:48.913020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:48.948813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e91d4-d1b0-4716-b6cd-1379eabd80c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:48.949700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e91d4-d1b0-4716-b6cd-1379eabd80c0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.949981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e91d4-d1b0-4716-b6cd-1379eabd80c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.950254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e91d4-d1b0-4716-b6cd-1379eabd80c0 None admin] PATH_INFO: `/v3/users/24f043f060e24197b7146fc46f2ee305` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.951342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e878-ce4a-446f-b09c-d7e2f5491d8e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:48.951517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e91d4-d1b0-4716-b6cd-1379eabd80c0 None admin] RBAC: Authorizing `identity:get_user(user_id=24f043f060e24197b7146fc46f2ee305)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:48.953104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e91d4-d1b0-4716-b6cd-1379eabd80c0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:48.954854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 41/77] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:48 2022] GET /identity/v3/users/24f043f060e24197b7146fc46f2ee305 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:48.956116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3d4df-167f-4702-9b5f-7f116e945a43 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.956401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3d4df-167f-4702-9b5f-7f116e945a43 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.957216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3d4df-167f-4702-9b5f-7f116e945a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:48.973943 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9fd3d4df-167f-4702-9b5f-7f116e945a43 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:48.975217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9fd3d4df-167f-4702-9b5f-7f116e945a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:48.987163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6af5c2-fcc1-435c-8025-5f573c07497b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:48.988043 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6af5c2-fcc1-435c-8025-5f573c07497b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:48.988324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6af5c2-fcc1-435c-8025-5f573c07497b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:48.988568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6af5c2-fcc1-435c-8025-5f573c07497b None admin] PATH_INFO: `/v3/users/6120ce90d3f04398b54f4c0245ad6ada` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:49.004756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6af5c2-fcc1-435c-8025-5f573c07497b None admin] RBAC: Authorizing `identity:get_user(user_id=6120ce90d3f04398b54f4c0245ad6ada)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:49.006236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6af5c2-fcc1-435c-8025-5f573c07497b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:49.008019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 37/78] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:48 2022] GET /identity/v3/users/6120ce90d3f04398b54f4c0245ad6ada => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:49.008798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6af5c2-fcc1-435c-8025-5f573c07497b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:49.040133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:49.049491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 42/79] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:49.050018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3d4df-167f-4702-9b5f-7f116e945a43 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:49.116882 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6af5c2-fcc1-435c-8025-5f573c07497b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:49.141710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:49.150647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c497d-2497-4d96-b16f-42166268483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:49.151120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3d4df-167f-4702-9b5f-7f116e945a43 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:49.151451 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c497d-2497-4d96-b16f-42166268483a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:49.151735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c497d-2497-4d96-b16f-42166268483a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:49.152010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c497d-2497-4d96-b16f-42166268483a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:49.162841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c497d-2497-4d96-b16f-42166268483a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-642c497d-2497-4d96-b16f-42166268483a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:49.170656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:49.171573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:49.172341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 38/80] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:49.173358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c497d-2497-4d96-b16f-42166268483a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:49.189150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157bbab-3b97-4150-a187-f1740fc61ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:49.190043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157bbab-3b97-4150-a187-f1740fc61ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:49.190330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157bbab-3b97-4150-a187-f1740fc61ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:49.190683 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157bbab-3b97-4150-a187-f1740fc61ba5 None admin] PATH_INFO: `/v3/users/6120ce90d3f04398b54f4c0245ad6ada` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:49.191899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157bbab-3b97-4150-a187-f1740fc61ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=6120ce90d3f04398b54f4c0245ad6ada)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:49.193364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157bbab-3b97-4150-a187-f1740fc61ba5 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:49.195053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 43/81] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:49 2022] GET /identity/v3/users/6120ce90d3f04398b54f4c0245ad6ada => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:49.195826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157bbab-3b97-4150-a187-f1740fc61ba5 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:49.261300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:49.276645 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c497d-2497-4d96-b16f-42166268483a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:49.301924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157bbab-3b97-4150-a187-f1740fc61ba5 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:49.309750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ce632-c27d-4bc3-b991-238dd3004bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:49.310427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ce632-c27d-4bc3-b991-238dd3004bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:49.310719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ce632-c27d-4bc3-b991-238dd3004bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:49.311038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ce632-c27d-4bc3-b991-238dd3004bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:49.336080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8397ba8-de66-4fd2-b359-1d870334bfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:49.336740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8397ba8-de66-4fd2-b359-1d870334bfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:49.337034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8397ba8-de66-4fd2-b359-1d870334bfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:49.337311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8397ba8-de66-4fd2-b359-1d870334bfd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:49.364009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:49.377737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ce632-c27d-4bc3-b991-238dd3004bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:49.379266 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ce632-c27d-4bc3-b991-238dd3004bf8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:49.407297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8397ba8-de66-4fd2-b359-1d870334bfd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:49.409133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8397ba8-de66-4fd2-b359-1d870334bfd9 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:49.470128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:49.479009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 39/82] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:06:49.479890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ce632-c27d-4bc3-b991-238dd3004bf8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:49.517178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 44/83] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:06:49.518475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8397ba8-de66-4fd2-b359-1d870334bfd9 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:49.574680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:49.590294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ce632-c27d-4bc3-b991-238dd3004bf8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:49.622650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8397ba8-de66-4fd2-b359-1d870334bfd9 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:49.628867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1882d6-77c7-44d0-85e2-7cd025f629ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:49.629679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1882d6-77c7-44d0-85e2-7cd025f629ef None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:49.629971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1882d6-77c7-44d0-85e2-7cd025f629ef None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:49.630249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1882d6-77c7-44d0-85e2-7cd025f629ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:49.631465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1882d6-77c7-44d0-85e2-7cd025f629ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:49.632930 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1882d6-77c7-44d0-85e2-7cd025f629ef None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:49.634630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 40/84] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:49.635420 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1882d6-77c7-44d0-85e2-7cd025f629ef None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:49.659624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769b482-4a1c-4092-8d9d-580cdb4755fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:49.660313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769b482-4a1c-4092-8d9d-580cdb4755fc None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:49.660620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769b482-4a1c-4092-8d9d-580cdb4755fc None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:49.660897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769b482-4a1c-4092-8d9d-580cdb4755fc None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:49.661649 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769b482-4a1c-4092-8d9d-580cdb4755fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:49.661956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769b482-4a1c-4092-8d9d-580cdb4755fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:49.663404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769b482-4a1c-4092-8d9d-580cdb4755fc None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:49.671705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 45/85] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:06:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:49.672538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769b482-4a1c-4092-8d9d-580cdb4755fc None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:49.696983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:49.749435 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1882d6-77c7-44d0-85e2-7cd025f629ef None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:49.775230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769b482-4a1c-4092-8d9d-580cdb4755fc None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:49.783647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb859f-a4ce-4a0d-8bfc-df6e8d761bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:49.784295 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb859f-a4ce-4a0d-8bfc-df6e8d761bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:49.784564 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb859f-a4ce-4a0d-8bfc-df6e8d761bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:49.785120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb859f-a4ce-4a0d-8bfc-df6e8d761bc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:49.810223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:49.810845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2127f-556d-46a8-a44d-85d8ea5460bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:49.812552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2127f-556d-46a8-a44d-85d8ea5460bf None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:49.812882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2127f-556d-46a8-a44d-85d8ea5460bf None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:49.813184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2127f-556d-46a8-a44d-85d8ea5460bf None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:49.814419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2127f-556d-46a8-a44d-85d8ea5460bf None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:49.815920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2127f-556d-46a8-a44d-85d8ea5460bf None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:49.817654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 46/86] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:49 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:49.823232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2127f-556d-46a8-a44d-85d8ea5460bf None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:49.857665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb859f-a4ce-4a0d-8bfc-df6e8d761bc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:49.859592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb859f-a4ce-4a0d-8bfc-df6e8d761bc0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:49.916098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:49.925406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2127f-556d-46a8-a44d-85d8ea5460bf None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:49.961497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832c2bf-f663-4689-b407-9540fb29c9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:49.962386 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832c2bf-f663-4689-b407-9540fb29c9eb None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:49.962702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832c2bf-f663-4689-b407-9540fb29c9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:49.962990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832c2bf-f663-4689-b407-9540fb29c9eb None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:49.964208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832c2bf-f663-4689-b407-9540fb29c9eb None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:49.964836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 41/87] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:06:49.965678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb859f-a4ce-4a0d-8bfc-df6e8d761bc0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:49.965773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832c2bf-f663-4689-b407-9540fb29c9eb None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:49.968060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 47/88] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:49 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:49.968764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832c2bf-f663-4689-b407-9540fb29c9eb None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:50.029942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:50.070171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832c2bf-f663-4689-b407-9540fb29c9eb None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:50.076722 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb859f-a4ce-4a0d-8bfc-df6e8d761bc0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:50.105160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff63871-8e14-4c56-8067-93cb60247a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:50.106043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff63871-8e14-4c56-8067-93cb60247a0c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:50.106334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff63871-8e14-4c56-8067-93cb60247a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:50.106651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff63871-8e14-4c56-8067-93cb60247a0c None admin] PATH_INFO: `/v3/users/6120ce90d3f04398b54f4c0245ad6ada` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:50.107963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff63871-8e14-4c56-8067-93cb60247a0c None admin] RBAC: Authorizing `identity:get_user(user_id=6120ce90d3f04398b54f4c0245ad6ada)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:50.109382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff63871-8e14-4c56-8067-93cb60247a0c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:50.111087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 48/89] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:49 2022] GET /identity/v3/users/6120ce90d3f04398b54f4c0245ad6ada => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:50.112543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32a403-aa32-4122-8fbd-ed1ae388bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:50.113237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32a403-aa32-4122-8fbd-ed1ae388bfb4 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:50.113523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32a403-aa32-4122-8fbd-ed1ae388bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:50.113802 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32a403-aa32-4122-8fbd-ed1ae388bfb4 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:50.114568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32a403-aa32-4122-8fbd-ed1ae388bfb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:50.116023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32a403-aa32-4122-8fbd-ed1ae388bfb4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:50.116524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff63871-8e14-4c56-8067-93cb60247a0c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:50.140702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 42/90] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:06:49 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:50.141827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32a403-aa32-4122-8fbd-ed1ae388bfb4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:50.146232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:50.244213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff63871-8e14-4c56-8067-93cb60247a0c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:50.277283 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32a403-aa32-4122-8fbd-ed1ae388bfb4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:50.286089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c215b4-6afc-4c78-9a3b-d880fee412af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:50.286812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c215b4-6afc-4c78-9a3b-d880fee412af None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:50.287103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c215b4-6afc-4c78-9a3b-d880fee412af None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:50.287385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c215b4-6afc-4c78-9a3b-d880fee412af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:50.288252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c215b4-6afc-4c78-9a3b-d880fee412af None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e, user.id=24f043f060e24197b7146fc46f2ee305) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:50.288572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c215b4-6afc-4c78-9a3b-d880fee412af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:50.290085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c215b4-6afc-4c78-9a3b-d880fee412af None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:50.290204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:50.296916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 49/91] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:50 2022] GET /identity/v3/role_assignments?user.id=24f043f060e24197b7146fc46f2ee305&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:50.297719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c215b4-6afc-4c78-9a3b-d880fee412af None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:50.327340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7fd48-f988-4214-b6b5-33f907a0efdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:50.328255 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7fd48-f988-4214-b6b5-33f907a0efdd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:50.329063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7fd48-f988-4214-b6b5-33f907a0efdd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:50.329063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7fd48-f988-4214-b6b5-33f907a0efdd None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:50.332446 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7fd48-f988-4214-b6b5-33f907a0efdd None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:50.333381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7fd48-f988-4214-b6b5-33f907a0efdd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:50.335421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 43/92] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:50 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:50.336232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7fd48-f988-4214-b6b5-33f907a0efdd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:50.436320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:50.450215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c215b4-6afc-4c78-9a3b-d880fee412af None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:50.483247 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7fd48-f988-4214-b6b5-33f907a0efdd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:50.506734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084279af-20a0-4a8c-9f12-b0ce8640fca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:50.507415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084279af-20a0-4a8c-9f12-b0ce8640fca9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:50.507702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084279af-20a0-4a8c-9f12-b0ce8640fca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:50.507982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084279af-20a0-4a8c-9f12-b0ce8640fca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:50.508828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084279af-20a0-4a8c-9f12-b0ce8640fca9 None admin] RBAC: Adding query filter params (role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e, user.id=6120ce90d3f04398b54f4c0245ad6ada) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:50.509143 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084279af-20a0-4a8c-9f12-b0ce8640fca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:50.511700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084279af-20a0-4a8c-9f12-b0ce8640fca9 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:50.522086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 50/93] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:50 2022] GET /identity/v3/role_assignments?user.id=6120ce90d3f04398b54f4c0245ad6ada&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:50.523213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084279af-20a0-4a8c-9f12-b0ce8640fca9 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:50.533623 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec252ad3-9cbb-4c23-87e4-945fb1a6a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:50.534714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec252ad3-9cbb-4c23-87e4-945fb1a6a0ed None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:50.535230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec252ad3-9cbb-4c23-87e4-945fb1a6a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:50.536492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec252ad3-9cbb-4c23-87e4-945fb1a6a0ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:50.646967 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:50.694675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec252ad3-9cbb-4c23-87e4-945fb1a6a0ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:50.698248 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec252ad3-9cbb-4c23-87e4-945fb1a6a0ed None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:50.738466 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084279af-20a0-4a8c-9f12-b0ce8640fca9 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:50.812111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 44/94] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:06:50.819615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec252ad3-9cbb-4c23-87e4-945fb1a6a0ed None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:50.831932 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37427a56-7bef-45fb-b950-2fcd7d8fdca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:50.832624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37427a56-7bef-45fb-b950-2fcd7d8fdca7 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:50.832916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37427a56-7bef-45fb-b950-2fcd7d8fdca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:50.833237 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37427a56-7bef-45fb-b950-2fcd7d8fdca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:50.834052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37427a56-7bef-45fb-b950-2fcd7d8fdca7 None admin] RBAC: Adding query filter params (role.id=26c081183cd3490c977d961b36b9cee4, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e, user.id=6120ce90d3f04398b54f4c0245ad6ada) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:50.834374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37427a56-7bef-45fb-b950-2fcd7d8fdca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:50.840043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37427a56-7bef-45fb-b950-2fcd7d8fdca7 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:50.849520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 51/95] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:50 2022] GET /identity/v3/role_assignments?user.id=6120ce90d3f04398b54f4c0245ad6ada&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=26c081183cd3490c977d961b36b9cee4 => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:50.930991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:50.955851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec252ad3-9cbb-4c23-87e4-945fb1a6a0ed None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:51.007707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aff8a9-e764-4d8a-827b-b4354fe9299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:51.008866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aff8a9-e764-4d8a-827b-b4354fe9299b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:51.009294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aff8a9-e764-4d8a-827b-b4354fe9299b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:51.009732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aff8a9-e764-4d8a-827b-b4354fe9299b None admin] PATH_INFO: `/v3/projects/e4de86cd35884816ab30ff5bae571ef9` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:51.011178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aff8a9-e764-4d8a-827b-b4354fe9299b None admin] RBAC: Authorizing `identity:get_project(project_id=e4de86cd35884816ab30ff5bae571ef9)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:51.012823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aff8a9-e764-4d8a-827b-b4354fe9299b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:51.015179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 45/96] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:50 2022] GET /identity/v3/projects/e4de86cd35884816ab30ff5bae571ef9 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:51.021344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37427a56-7bef-45fb-b950-2fcd7d8fdca7 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:51.067052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:51.165040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37427a56-7bef-45fb-b950-2fcd7d8fdca7 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:51.201580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296fca7-819f-43bb-bc89-afbd1f7539c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:51.202265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296fca7-819f-43bb-bc89-afbd1f7539c9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:51.202575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296fca7-819f-43bb-bc89-afbd1f7539c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:51.202859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296fca7-819f-43bb-bc89-afbd1f7539c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:51.203720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296fca7-819f-43bb-bc89-afbd1f7539c9 None admin] RBAC: Adding query filter params (role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, scope.project.id=e4de86cd35884816ab30ff5bae571ef9, user.id=6120ce90d3f04398b54f4c0245ad6ada) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:51.204042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296fca7-819f-43bb-bc89-afbd1f7539c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:51.205520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296fca7-819f-43bb-bc89-afbd1f7539c9 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:51.212094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 52/97] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:51 2022] GET /identity/v3/role_assignments?user.id=6120ce90d3f04398b54f4c0245ad6ada&scope.project.id=e4de86cd35884816ab30ff5bae571ef9&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:52.686343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c87ce-42ce-4617-ac7c-f04726a53862 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:52.686893 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c87ce-42ce-4617-ac7c-f04726a53862 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:52.686967 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c87ce-42ce-4617-ac7c-f04726a53862 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:52.688622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 46/98] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:52.694279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc791c-31b7-48ce-847a-94cc0a35f061 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:52.694775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc791c-31b7-48ce-847a-94cc0a35f061 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:52.694958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc791c-31b7-48ce-847a-94cc0a35f061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:52.717412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-cbdc791c-31b7-48ce-847a-94cc0a35f061 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:52.718651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cbdc791c-31b7-48ce-847a-94cc0a35f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:52.795157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 53/99] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:52.817321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c87ce-42ce-4617-ac7c-f04726a53862 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:52.952848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c87ce-42ce-4617-ac7c-f04726a53862 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:53.002185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af238ba0-d52e-427e-84f5-1ec601bb26e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:53.003039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af238ba0-d52e-427e-84f5-1ec601bb26e8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:53.003324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af238ba0-d52e-427e-84f5-1ec601bb26e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:53.003598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af238ba0-d52e-427e-84f5-1ec601bb26e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:53.015639 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af238ba0-d52e-427e-84f5-1ec601bb26e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-af238ba0-d52e-427e-84f5-1ec601bb26e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:53.023555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:53.024500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:53.025270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 47/100] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:53.034994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc791c-31b7-48ce-847a-94cc0a35f061 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:53.054981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:53.160027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc791c-31b7-48ce-847a-94cc0a35f061 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:53.231703 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293d2f0-e9f9-4ae4-b218-bcc320613f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:53.233000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293d2f0-e9f9-4ae4-b218-bcc320613f44 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:53.233520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293d2f0-e9f9-4ae4-b218-bcc320613f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:53.234030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293d2f0-e9f9-4ae4-b218-bcc320613f44 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:53.235528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293d2f0-e9f9-4ae4-b218-bcc320613f44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:53.236086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293d2f0-e9f9-4ae4-b218-bcc320613f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:53.238714 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293d2f0-e9f9-4ae4-b218-bcc320613f44 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:53.254898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 54/101] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:53.263842 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af238ba0-d52e-427e-84f5-1ec601bb26e8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:53.291224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:53.356480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c885d37-75c7-4b4e-9b84-1b01366dbf7c None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:53.357153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c885d37-75c7-4b4e-9b84-1b01366dbf7c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:53.357734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c885d37-75c7-4b4e-9b84-1b01366dbf7c None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:53.359390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 55/102] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:06:53.364647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008f58-e1f0-4ef6-a58c-d5896a48c3f8 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:53.365174 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008f58-e1f0-4ef6-a58c-d5896a48c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:53.365652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008f58-e1f0-4ef6-a58c-d5896a48c3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:53.395349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-82008f58-e1f0-4ef6-a58c-d5896a48c3f8 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:53.396989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-82008f58-e1f0-4ef6-a58c-d5896a48c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:53.548087 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af238ba0-d52e-427e-84f5-1ec601bb26e8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:53.579926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 56/103] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:06:53.618379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008f58-e1f0-4ef6-a58c-d5896a48c3f8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:53.632948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:53.649557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02922cc-d319-4b8b-96fe-938f0a5dacc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:53.651020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02922cc-d319-4b8b-96fe-938f0a5dacc8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:53.651485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02922cc-d319-4b8b-96fe-938f0a5dacc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:53.652543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02922cc-d319-4b8b-96fe-938f0a5dacc8 None admin] PATH_INFO: `/v3/users/24f043f060e24197b7146fc46f2ee305` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:53.659976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02922cc-d319-4b8b-96fe-938f0a5dacc8 None admin] RBAC: Authorizing `identity:get_user(user_id=24f043f060e24197b7146fc46f2ee305)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:53.662761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02922cc-d319-4b8b-96fe-938f0a5dacc8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:53.666299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 48/104] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:53 2022] GET /identity/v3/users/24f043f060e24197b7146fc46f2ee305 => generated 247 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:53.676190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02922cc-d319-4b8b-96fe-938f0a5dacc8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:53.847002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008f58-e1f0-4ef6-a58c-d5896a48c3f8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:53.910112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:53.947723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdad07-27cb-4202-94c5-75fce31c2399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:53.948993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdad07-27cb-4202-94c5-75fce31c2399 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:53.949450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdad07-27cb-4202-94c5-75fce31c2399 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:53.949896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdad07-27cb-4202-94c5-75fce31c2399 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:53.953186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdad07-27cb-4202-94c5-75fce31c2399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:53.956781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdad07-27cb-4202-94c5-75fce31c2399 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:53.959701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 57/105] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:53.961654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12ec6-536f-45d6-9c80-16968ee97688 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:53.962139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12ec6-536f-45d6-9c80-16968ee97688 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:53.965212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12ec6-536f-45d6-9c80-16968ee97688 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:53.972013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02922cc-d319-4b8b-96fe-938f0a5dacc8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:53.976258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 58/106] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:53 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:53.977107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d12ec6-536f-45d6-9c80-16968ee97688 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:54.029837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c037809-0b75-4157-8daf-30a9810e705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:54.031281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c037809-0b75-4157-8daf-30a9810e705f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.031866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c037809-0b75-4157-8daf-30a9810e705f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.032345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c037809-0b75-4157-8daf-30a9810e705f None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.034544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c037809-0b75-4157-8daf-30a9810e705f None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:54.036484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c037809-0b75-4157-8daf-30a9810e705f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:54.038689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 49/107] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:53 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:06:54.040385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32770b9-de9d-4341-abe9-e3edd572a50c None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.040900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32770b9-de9d-4341-abe9-e3edd572a50c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.041558 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32770b9-de9d-4341-abe9-e3edd572a50c None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.043220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 50/108] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:54.048884 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b9c3e-5190-4cf4-9190-68e8b27787a6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.049486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b9c3e-5190-4cf4-9190-68e8b27787a6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.050006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b9c3e-5190-4cf4-9190-68e8b27787a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.069943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-499b9c3e-5190-4cf4-9190-68e8b27787a6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:54.071753 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-499b9c3e-5190-4cf4-9190-68e8b27787a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:54.084885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:54.114791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d12ec6-536f-45d6-9c80-16968ee97688 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:54.161212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab8ee7-831b-4cb1-9f83-2e8aa5f57c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:54.161883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab8ee7-831b-4cb1-9f83-2e8aa5f57c3b None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.162166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab8ee7-831b-4cb1-9f83-2e8aa5f57c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.162442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab8ee7-831b-4cb1-9f83-2e8aa5f57c3b None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.163025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 51/109] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:54.163239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab8ee7-831b-4cb1-9f83-2e8aa5f57c3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:54.164216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b9c3e-5190-4cf4-9190-68e8b27787a6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:54.164747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab8ee7-831b-4cb1-9f83-2e8aa5f57c3b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:54.203771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 59/110] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:06:53 2022] POST /identity/v3/projects => generated 302 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:54.204916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b7a8-cde3-4599-b508-d70e1b82475f None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.205206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b7a8-cde3-4599-b508-d70e1b82475f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.205478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b7a8-cde3-4599-b508-d70e1b82475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.229680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c140b7a8-cde3-4599-b508-d70e1b82475f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:54.232623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c140b7a8-cde3-4599-b508-d70e1b82475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:54.279708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:54.319764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b9c3e-5190-4cf4-9190-68e8b27787a6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:54.334257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 60/111] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:54.336368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21b4b2-30d0-450e-93aa-2cf862ea59cb None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.336661 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21b4b2-30d0-450e-93aa-2cf862ea59cb None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.336938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21b4b2-30d0-450e-93aa-2cf862ea59cb None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.342854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 61/112] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:54.343830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21b4b2-30d0-450e-93aa-2cf862ea59cb None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:54.377199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17948426-4701-442a-aeea-7d4e20c6f254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:54.378535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17948426-4701-442a-aeea-7d4e20c6f254 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.378535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17948426-4701-442a-aeea-7d4e20c6f254 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.378535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17948426-4701-442a-aeea-7d4e20c6f254 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/users/24f043f060e24197b7146fc46f2ee305/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.381949 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17948426-4701-442a-aeea-7d4e20c6f254 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b645eb49c354c1c96fc1d2f25352d6e, user_id=24f043f060e24197b7146fc46f2ee305, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:54.382564 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17948426-4701-442a-aeea-7d4e20c6f254 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:54.401056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 52/113] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:06:54 2022] PUT /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/users/24f043f060e24197b7146fc46f2ee305/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:06:54.402397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb997239-047e-4a37-a105-a726a25c822e None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.403006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb997239-047e-4a37-a105-a726a25c822e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.403006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb997239-047e-4a37-a105-a726a25c822e None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.404920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 53/114] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:54.407379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fb136-8312-4ca3-b69c-482d25b88a3c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.407809 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fb136-8312-4ca3-b69c-482d25b88a3c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.408194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fb136-8312-4ca3-b69c-482d25b88a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.419898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:54.432235 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-eb9fb136-8312-4ca3-b69c-482d25b88a3c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:54.433519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eb9fb136-8312-4ca3-b69c-482d25b88a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:54.491113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21b4b2-30d0-450e-93aa-2cf862ea59cb None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:54.537179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 54/115] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:54.537888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6c73-ee24-41f8-a929-d8e71d2c3bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:54.538685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fb136-8312-4ca3-b69c-482d25b88a3c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:54.538798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6c73-ee24-41f8-a929-d8e71d2c3bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.539041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6c73-ee24-41f8-a929-d8e71d2c3bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.539325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6c73-ee24-41f8-a929-d8e71d2c3bf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.554184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b6c73-ee24-41f8-a929-d8e71d2c3bf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-353b6c73-ee24-41f8-a929-d8e71d2c3bf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:54.562934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:54.564098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:06:54.565203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 62/116] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:54.566097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4651ed-51cc-418a-b36b-b90987a0f849 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.566097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4651ed-51cc-418a-b36b-b90987a0f849 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.566374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4651ed-51cc-418a-b36b-b90987a0f849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.587845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8b4651ed-51cc-418a-b36b-b90987a0f849 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:54.589138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8b4651ed-51cc-418a-b36b-b90987a0f849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:54.629239 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:54.683573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 63/117] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:54.684526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4651ed-51cc-418a-b36b-b90987a0f849 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:54.685424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fb136-8312-4ca3-b69c-482d25b88a3c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:54.728745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22457b-a6fb-48bf-a464-3e236fd37c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:54.729559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22457b-a6fb-48bf-a464-3e236fd37c9b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.729842 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22457b-a6fb-48bf-a464-3e236fd37c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.730112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22457b-a6fb-48bf-a464-3e236fd37c9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.742086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22457b-a6fb-48bf-a464-3e236fd37c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-ad22457b-a6fb-48bf-a464-3e236fd37c9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:54.750044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:54.750989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:54.752245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 55/118] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:54.752891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22457b-a6fb-48bf-a464-3e236fd37c9b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:54.752955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:54.835780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4651ed-51cc-418a-b36b-b90987a0f849 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:54.870162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcbc13-9df1-48f6-92de-8a53adcdc3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:54.870947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcbc13-9df1-48f6-92de-8a53adcdc3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.871152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcbc13-9df1-48f6-92de-8a53adcdc3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.871429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcbc13-9df1-48f6-92de-8a53adcdc3d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.872185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcbc13-9df1-48f6-92de-8a53adcdc3d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:54.872488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcbc13-9df1-48f6-92de-8a53adcdc3d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:54.873964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcbc13-9df1-48f6-92de-8a53adcdc3d3 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:54.874457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22457b-a6fb-48bf-a464-3e236fd37c9b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:54.882800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 64/119] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:06:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:54.883559 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcbc13-9df1-48f6-92de-8a53adcdc3d3 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:54.902589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:54.918686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7475e7-8f7c-4624-bf31-4ce41bf6923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:54.920773 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7475e7-8f7c-4624-bf31-4ce41bf6923d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:54.921208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7475e7-8f7c-4624-bf31-4ce41bf6923d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:54.921653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7475e7-8f7c-4624-bf31-4ce41bf6923d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:54.935538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7475e7-8f7c-4624-bf31-4ce41bf6923d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3c7475e7-8f7c-4624-bf31-4ce41bf6923d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:54.945613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:54.946721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:06:54.947525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:54.950013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 56/120] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:54.951347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7475e7-8f7c-4624-bf31-4ce41bf6923d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:54.998367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcbc13-9df1-48f6-92de-8a53adcdc3d3 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.027031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:55.046815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3d32a-b0d9-4e75-a6a3-c461a00570f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.048105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d32a-b0d9-4e75-a6a3-c461a00570f9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.048615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d32a-b0d9-4e75-a6a3-c461a00570f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.049105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d32a-b0d9-4e75-a6a3-c461a00570f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.062441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3d32a-b0d9-4e75-a6a3-c461a00570f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-03d3d32a-b0d9-4e75-a6a3-c461a00570f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:55.071926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:55.072893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:06:55.073666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:06:55.076334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 65/121] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:06:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:55.077593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3d32a-b0d9-4e75-a6a3-c461a00570f9 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:55.080997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7475e7-8f7c-4624-bf31-4ce41bf6923d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.123111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d36b20-18f2-4589-a413-996eee81f1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.124233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d36b20-18f2-4589-a413-996eee81f1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.124710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d36b20-18f2-4589-a413-996eee81f1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.125201 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d36b20-18f2-4589-a413-996eee81f1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.126142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d36b20-18f2-4589-a413-996eee81f1c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:55.126712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d36b20-18f2-4589-a413-996eee81f1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:55.128350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d36b20-18f2-4589-a413-996eee81f1c3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:55.138170 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 57/122] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:06:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:55.139439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d36b20-18f2-4589-a413-996eee81f1c3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:55.194069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3d32a-b0d9-4e75-a6a3-c461a00570f9 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.203090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:55.229547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361997-fda7-4232-bce5-3c4c4a878374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.230976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361997-fda7-4232-bce5-3c4c4a878374 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.231451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361997-fda7-4232-bce5-3c4c4a878374 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.232475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361997-fda7-4232-bce5-3c4c4a878374 None admin] PATH_INFO: `/v3/users/6120ce90d3f04398b54f4c0245ad6ada` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.234370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83361997-fda7-4232-bce5-3c4c4a878374 None admin] RBAC: Authorizing `identity:get_user(user_id=6120ce90d3f04398b54f4c0245ad6ada)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:55.237251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83361997-fda7-4232-bce5-3c4c4a878374 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:55.246651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 66/123] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:55 2022] GET /identity/v3/users/6120ce90d3f04398b54f4c0245ad6ada => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:55.246651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361997-fda7-4232-bce5-3c4c4a878374 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:55.275011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d36b20-18f2-4589-a413-996eee81f1c3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.286244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:55.314174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da6261-da37-4612-a08b-e001a6108935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.315239 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6261-da37-4612-a08b-e001a6108935 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.315714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6261-da37-4612-a08b-e001a6108935 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.316226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6261-da37-4612-a08b-e001a6108935 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.317258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da6261-da37-4612-a08b-e001a6108935 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:55.317777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da6261-da37-4612-a08b-e001a6108935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:55.319408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da6261-da37-4612-a08b-e001a6108935 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:55.329785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 58/124] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:06:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:55.331198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da6261-da37-4612-a08b-e001a6108935 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:55.359302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361997-fda7-4232-bce5-3c4c4a878374 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.400875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97898672-32a3-4600-9a1f-6ad177b01a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.401489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898672-32a3-4600-9a1f-6ad177b01a52 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.401778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898672-32a3-4600-9a1f-6ad177b01a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.402063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898672-32a3-4600-9a1f-6ad177b01a52 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.402995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97898672-32a3-4600-9a1f-6ad177b01a52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:55.403426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97898672-32a3-4600-9a1f-6ad177b01a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:55.406075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97898672-32a3-4600-9a1f-6ad177b01a52 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:55.415293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 67/125] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:06:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:55.416001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97898672-32a3-4600-9a1f-6ad177b01a52 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:55.457381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da6261-da37-4612-a08b-e001a6108935 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.467657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:55.496896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987e623-8cb7-4f6c-a6cb-8e5e07d8e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.497960 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987e623-8cb7-4f6c-a6cb-8e5e07d8e248 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.498821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987e623-8cb7-4f6c-a6cb-8e5e07d8e248 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.499212 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987e623-8cb7-4f6c-a6cb-8e5e07d8e248 None admin] PATH_INFO: `/v3/users/2668ca2b24c247619bd9fb7566021a1f` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.514148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987e623-8cb7-4f6c-a6cb-8e5e07d8e248 None admin] RBAC: Authorizing `identity:get_user(user_id=2668ca2b24c247619bd9fb7566021a1f)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:55.515860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987e623-8cb7-4f6c-a6cb-8e5e07d8e248 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:55.517919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 59/126] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:55 2022] GET /identity/v3/users/2668ca2b24c247619bd9fb7566021a1f => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:55.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987e623-8cb7-4f6c-a6cb-8e5e07d8e248 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:55.531760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97898672-32a3-4600-9a1f-6ad177b01a52 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.535208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:55.570710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13dcd-cbbd-4625-ab71-9692978d1a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.571610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13dcd-cbbd-4625-ab71-9692978d1a9e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.571902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13dcd-cbbd-4625-ab71-9692978d1a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.572182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13dcd-cbbd-4625-ab71-9692978d1a9e None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.573539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed13dcd-cbbd-4625-ab71-9692978d1a9e None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:55.575111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed13dcd-cbbd-4625-ab71-9692978d1a9e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:55.576921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 68/127] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:55 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:55.577720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13dcd-cbbd-4625-ab71-9692978d1a9e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:55.656670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987e623-8cb7-4f6c-a6cb-8e5e07d8e248 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.687182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13dcd-cbbd-4625-ab71-9692978d1a9e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.696792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35155575-f7b9-4d77-8090-c42bc68b36f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.697789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35155575-f7b9-4d77-8090-c42bc68b36f8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.698145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35155575-f7b9-4d77-8090-c42bc68b36f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.698488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35155575-f7b9-4d77-8090-c42bc68b36f8 None admin] PATH_INFO: `/v3/users/6120ce90d3f04398b54f4c0245ad6ada` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.699852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35155575-f7b9-4d77-8090-c42bc68b36f8 None admin] RBAC: Authorizing `identity:get_user(user_id=6120ce90d3f04398b54f4c0245ad6ada)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:55.701445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35155575-f7b9-4d77-8090-c42bc68b36f8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:55.704151 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 60/128] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:55 2022] GET /identity/v3/users/6120ce90d3f04398b54f4c0245ad6ada => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:55.705021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35155575-f7b9-4d77-8090-c42bc68b36f8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:55.723630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa07b0f-e3b0-4c62-a5d4-b0800fe05b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.724547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07b0f-e3b0-4c62-a5d4-b0800fe05b34 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.724839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07b0f-e3b0-4c62-a5d4-b0800fe05b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.725123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07b0f-e3b0-4c62-a5d4-b0800fe05b34 None admin] PATH_INFO: `/v3/users/6120ce90d3f04398b54f4c0245ad6ada` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.726455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa07b0f-e3b0-4c62-a5d4-b0800fe05b34 None admin] RBAC: Authorizing `identity:get_user(user_id=6120ce90d3f04398b54f4c0245ad6ada)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:55.728057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa07b0f-e3b0-4c62-a5d4-b0800fe05b34 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:55.729948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 69/129] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:55 2022] GET /identity/v3/users/6120ce90d3f04398b54f4c0245ad6ada => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:55.730626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa07b0f-e3b0-4c62-a5d4-b0800fe05b34 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:55.741338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:55.770873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:55.824417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35155575-f7b9-4d77-8090-c42bc68b36f8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.838342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa07b0f-e3b0-4c62-a5d4-b0800fe05b34 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:55.859704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fd2c0-47b3-4df1-a3cd-e17f937cd521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.860454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fd2c0-47b3-4df1-a3cd-e17f937cd521 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.860829 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fd2c0-47b3-4df1-a3cd-e17f937cd521 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.861272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fd2c0-47b3-4df1-a3cd-e17f937cd521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.874803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadc1ed-7f1b-4aa7-9038-75f62303390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:55.875814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadc1ed-7f1b-4aa7-9038-75f62303390f None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:55.876103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadc1ed-7f1b-4aa7-9038-75f62303390f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:55.876500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadc1ed-7f1b-4aa7-9038-75f62303390f None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/users/6120ce90d3f04398b54f4c0245ad6ada/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:55.878647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadc1ed-7f1b-4aa7-9038-75f62303390f None admin] RBAC: Authorizing `identity:create_grant(project_id=2b645eb49c354c1c96fc1d2f25352d6e, user_id=6120ce90d3f04398b54f4c0245ad6ada, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:55.880251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadc1ed-7f1b-4aa7-9038-75f62303390f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:55.901264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 70/130] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:06:55 2022] PUT /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/users/6120ce90d3f04398b54f4c0245ad6ada/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:06:55.901946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadc1ed-7f1b-4aa7-9038-75f62303390f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:56.013317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fd2c0-47b3-4df1-a3cd-e17f937cd521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:56.015034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fd2c0-47b3-4df1-a3cd-e17f937cd521 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:56.018975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:56.032506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadc1ed-7f1b-4aa7-9038-75f62303390f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:56.078250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288ef1f-6488-4719-9965-834cce39171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:56.079363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288ef1f-6488-4719-9965-834cce39171f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:56.079663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288ef1f-6488-4719-9965-834cce39171f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:56.079957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288ef1f-6488-4719-9965-834cce39171f None admin] PATH_INFO: `/v3/projects/e4de86cd35884816ab30ff5bae571ef9` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:56.081300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288ef1f-6488-4719-9965-834cce39171f None admin] RBAC: Authorizing `identity:get_project(project_id=e4de86cd35884816ab30ff5bae571ef9)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:56.082942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288ef1f-6488-4719-9965-834cce39171f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:56.084782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 71/131] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:55 2022] GET /identity/v3/projects/e4de86cd35884816ab30ff5bae571ef9 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:56.085666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288ef1f-6488-4719-9965-834cce39171f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:56.090580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:56.198154 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 61/132] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:06:56.199041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fd2c0-47b3-4df1-a3cd-e17f937cd521 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:56.205729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288ef1f-6488-4719-9965-834cce39171f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:56.244362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502564-f2ac-4e98-90ab-eabc55c34146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:56.245261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502564-f2ac-4e98-90ab-eabc55c34146 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:56.245549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502564-f2ac-4e98-90ab-eabc55c34146 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:56.245840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502564-f2ac-4e98-90ab-eabc55c34146 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:56.247099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502564-f2ac-4e98-90ab-eabc55c34146 None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:56.248827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502564-f2ac-4e98-90ab-eabc55c34146 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:56.250787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 72/133] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:56 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:56.251588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502564-f2ac-4e98-90ab-eabc55c34146 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:56.286315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:56.336197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fd2c0-47b3-4df1-a3cd-e17f937cd521 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:56.402540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:56.411363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045d95e-4ef7-4951-9e0f-8b50f7b0108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:56.412281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045d95e-4ef7-4951-9e0f-8b50f7b0108a None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:56.412564 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045d95e-4ef7-4951-9e0f-8b50f7b0108a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:56.412842 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045d95e-4ef7-4951-9e0f-8b50f7b0108a None admin] PATH_INFO: `/v3/projects/e4de86cd35884816ab30ff5bae571ef9/users/6120ce90d3f04398b54f4c0245ad6ada/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:56.415729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045d95e-4ef7-4951-9e0f-8b50f7b0108a None admin] RBAC: Authorizing `identity:create_grant(project_id=e4de86cd35884816ab30ff5bae571ef9, user_id=6120ce90d3f04398b54f4c0245ad6ada, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:56.417202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045d95e-4ef7-4951-9e0f-8b50f7b0108a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:56.430595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502564-f2ac-4e98-90ab-eabc55c34146 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:56.445734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 62/134] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:06:56 2022] PUT /identity/v3/projects/e4de86cd35884816ab30ff5bae571ef9/users/6120ce90d3f04398b54f4c0245ad6ada/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:06:56.446326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045d95e-4ef7-4951-9e0f-8b50f7b0108a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:56.507201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1a5cf-d990-4b12-bbf7-61353bd4a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:56.508103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1a5cf-d990-4b12-bbf7-61353bd4a87a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:56.508572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1a5cf-d990-4b12-bbf7-61353bd4a87a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:56.508858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1a5cf-d990-4b12-bbf7-61353bd4a87a None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:56.510277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1a5cf-d990-4b12-bbf7-61353bd4a87a None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:56.511880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1a5cf-d990-4b12-bbf7-61353bd4a87a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:56.513753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 73/135] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:56 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:56.521706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1a5cf-d990-4b12-bbf7-61353bd4a87a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:56.623035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045d95e-4ef7-4951-9e0f-8b50f7b0108a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:56.665715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624e3c6-d669-46a0-9d5f-66c1fd9ed17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:56.666668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e3c6-d669-46a0-9d5f-66c1fd9ed17f None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:56.667141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e3c6-d669-46a0-9d5f-66c1fd9ed17f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:56.667421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e3c6-d669-46a0-9d5f-66c1fd9ed17f None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/users/6120ce90d3f04398b54f4c0245ad6ada/roles/26c081183cd3490c977d961b36b9cee4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:56.670027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624e3c6-d669-46a0-9d5f-66c1fd9ed17f None admin] RBAC: Authorizing `identity:create_grant(project_id=2b645eb49c354c1c96fc1d2f25352d6e, user_id=6120ce90d3f04398b54f4c0245ad6ada, role_id=26c081183cd3490c977d961b36b9cee4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:56.671645 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624e3c6-d669-46a0-9d5f-66c1fd9ed17f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:56.688853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 63/136] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:06:56 2022] PUT /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/users/6120ce90d3f04398b54f4c0245ad6ada/roles/26c081183cd3490c977d961b36b9cee4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:06:56.690650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecd73a-7cd7-4f76-9cca-b734fed72e8f None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:56.691017 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecd73a-7cd7-4f76-9cca-b734fed72e8f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:56.691589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecd73a-7cd7-4f76-9cca-b734fed72e8f None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:56.693352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 64/137] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:56.700878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83c93d-e627-4d05-9f75-b5b2d9fa3c5d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:56.701231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83c93d-e627-4d05-9f75-b5b2d9fa3c5d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:56.701621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83c93d-e627-4d05-9f75-b5b2d9fa3c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:56.729985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0f83c93d-e627-4d05-9f75-b5b2d9fa3c5d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:56.731722 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0f83c93d-e627-4d05-9f75-b5b2d9fa3c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:56.766465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:56.771513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1a5cf-d990-4b12-bbf7-61353bd4a87a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:56.810966 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:56.816159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 65/138] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:06:56.816981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e926f-8386-49cf-9c12-d3f90666962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:56.817841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e926f-8386-49cf-9c12-d3f90666962c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:56.818225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e926f-8386-49cf-9c12-d3f90666962c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:56.824195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e926f-8386-49cf-9c12-d3f90666962c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:56.824195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e926f-8386-49cf-9c12-d3f90666962c None admin] RBAC: Adding query filter params (role.id=819710d7e2594120b7d6b2e9c3b5d102, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e, user.id=2668ca2b24c247619bd9fb7566021a1f) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:56.824195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e926f-8386-49cf-9c12-d3f90666962c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:56.824195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e926f-8386-49cf-9c12-d3f90666962c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:56.824911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d2f5-94cd-4cd0-a397-8656cca01033 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:56.825439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d2f5-94cd-4cd0-a397-8656cca01033 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:56.825965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d2f5-94cd-4cd0-a397-8656cca01033 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:56.827897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 66/139] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:56.830540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 74/140] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:56 2022] GET /identity/v3/role_assignments?user.id=2668ca2b24c247619bd9fb7566021a1f&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=819710d7e2594120b7d6b2e9c3b5d102 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:06:56.834539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6848c-433c-40eb-aefc-098b355666ef None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:56.834539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6848c-433c-40eb-aefc-098b355666ef None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:56.834539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6848c-433c-40eb-aefc-098b355666ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:56.866770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1da6848c-433c-40eb-aefc-098b355666ef None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:56.868075 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1da6848c-433c-40eb-aefc-098b355666ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:56.873546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e926f-8386-49cf-9c12-d3f90666962c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:57.016197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e926f-8386-49cf-9c12-d3f90666962c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:57.059010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a014d2c-3f3f-4786-b364-a47f1e60d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:57.060269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a014d2c-3f3f-4786-b364-a47f1e60d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:57.061037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a014d2c-3f3f-4786-b364-a47f1e60d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:57.061529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a014d2c-3f3f-4786-b364-a47f1e60d2d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:57.063117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a014d2c-3f3f-4786-b364-a47f1e60d2d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:57.064950 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a014d2c-3f3f-4786-b364-a47f1e60d2d0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:57.067296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 75/141] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:57.075615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a014d2c-3f3f-4786-b364-a47f1e60d2d0 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:57.088272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 67/142] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:06:57.123855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6848c-433c-40eb-aefc-098b355666ef None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:57.129171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:57.290371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a014d2c-3f3f-4786-b364-a47f1e60d2d0 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:57.295703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6848c-433c-40eb-aefc-098b355666ef None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:57.311810 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:57.333983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883b19-5b8f-401c-8530-3db1f34b53f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:57.335368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883b19-5b8f-401c-8530-3db1f34b53f5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:57.335948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883b19-5b8f-401c-8530-3db1f34b53f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:57.336427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883b19-5b8f-401c-8530-3db1f34b53f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:57.348504 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43883b19-5b8f-401c-8530-3db1f34b53f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-43883b19-5b8f-401c-8530-3db1f34b53f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:57.356801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:57.357789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:57.358656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:57.361833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 68/143] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:06:57.367430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883b19-5b8f-401c-8530-3db1f34b53f5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:57.386654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2266-5bae-4e61-8d19-369ca79f1b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:57.387179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2266-5bae-4e61-8d19-369ca79f1b79 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:57.387461 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2266-5bae-4e61-8d19-369ca79f1b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:57.387737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2266-5bae-4e61-8d19-369ca79f1b79 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:57.388723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e2266-5bae-4e61-8d19-369ca79f1b79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:57.390286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e2266-5bae-4e61-8d19-369ca79f1b79 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:57.440972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 76/144] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:06:57 2022] POST /identity/v3/users => generated 283 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:57.511259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883b19-5b8f-401c-8530-3db1f34b53f5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:57.557150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9a41e-665b-4b9c-9c0a-d77866e142db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:57.558204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9a41e-665b-4b9c-9c0a-d77866e142db None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:57.558736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9a41e-665b-4b9c-9c0a-d77866e142db None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:57.559234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9a41e-665b-4b9c-9c0a-d77866e142db None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:57.560237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9a41e-665b-4b9c-9c0a-d77866e142db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:57.560819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9a41e-665b-4b9c-9c0a-d77866e142db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:57.562659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9a41e-665b-4b9c-9c0a-d77866e142db None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:57.578531 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 69/145] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:06:57.580848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2266-5bae-4e61-8d19-369ca79f1b79 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:57.715808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:57.737769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2266-5bae-4e61-8d19-369ca79f1b79 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:57.785774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1298b-e99f-4a20-91cb-117f3214e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:57.786706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1298b-e99f-4a20-91cb-117f3214e234 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:57.786987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1298b-e99f-4a20-91cb-117f3214e234 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:57.787260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1298b-e99f-4a20-91cb-117f3214e234 None admin] PATH_INFO: `/v3/users/24f043f060e24197b7146fc46f2ee305` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:57.789779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1298b-e99f-4a20-91cb-117f3214e234 None admin] RBAC: Authorizing `identity:get_user(user_id=24f043f060e24197b7146fc46f2ee305)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:57.791384 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1298b-e99f-4a20-91cb-117f3214e234 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:57.793115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 77/146] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:57 2022] GET /identity/v3/users/24f043f060e24197b7146fc46f2ee305 => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:57.798867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9a41e-665b-4b9c-9c0a-d77866e142db None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:57.858896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:57.947296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9a41e-665b-4b9c-9c0a-d77866e142db None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:57.995392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584496-4c32-49de-8a24-446080fbdde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:57.996258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584496-4c32-49de-8a24-446080fbdde9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:57.996546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584496-4c32-49de-8a24-446080fbdde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:57.996817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584496-4c32-49de-8a24-446080fbdde9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:58.082302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f584496-4c32-49de-8a24-446080fbdde9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:58.083818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f584496-4c32-49de-8a24-446080fbdde9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:58.126964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:58.211340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 70/147] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:06:58.217233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1298b-e99f-4a20-91cb-117f3214e234 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:58.361286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1298b-e99f-4a20-91cb-117f3214e234 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:58.401988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33534988-671a-4c6e-8009-68e0d9f80e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:58.403418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33534988-671a-4c6e-8009-68e0d9f80e5a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:58.403986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33534988-671a-4c6e-8009-68e0d9f80e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:58.404524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33534988-671a-4c6e-8009-68e0d9f80e5a None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:58.405953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33534988-671a-4c6e-8009-68e0d9f80e5a None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:58.407725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33534988-671a-4c6e-8009-68e0d9f80e5a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:58.410082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 78/148] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:58 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:58.418539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584496-4c32-49de-8a24-446080fbdde9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:58.565636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b953-249d-4c54-914e-9dcc2c9ba512 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:58.566283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b953-249d-4c54-914e-9dcc2c9ba512 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:58.566802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b953-249d-4c54-914e-9dcc2c9ba512 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:58.568491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 79/149] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:06:58.571991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584496-4c32-49de-8a24-446080fbdde9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:58.579983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5058f-db5a-43d7-a632-1baf84942f86 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:58.580347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5058f-db5a-43d7-a632-1baf84942f86 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:58.580730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5058f-db5a-43d7-a632-1baf84942f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:58.602023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-dfd5058f-db5a-43d7-a632-1baf84942f86 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:58.603526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-dfd5058f-db5a-43d7-a632-1baf84942f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:58.624135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:58.653633 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eecab2-d729-4730-a509-235c61e9a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:58.654691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eecab2-d729-4730-a509-235c61e9a62e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:58.655082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eecab2-d729-4730-a509-235c61e9a62e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:58.655387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eecab2-d729-4730-a509-235c61e9a62e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:58.656494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eecab2-d729-4730-a509-235c61e9a62e None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e, user.id=24f043f060e24197b7146fc46f2ee305) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:58.656805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eecab2-d729-4730-a509-235c61e9a62e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:58.658612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eecab2-d729-4730-a509-235c61e9a62e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:58.661870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:58.676829 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 71/150] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:58 2022] GET /identity/v3/role_assignments?user.id=24f043f060e24197b7146fc46f2ee305&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:58.691900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 80/151] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:06:58.717293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eecab2-d729-4730-a509-235c61e9a62e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:58.837223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eecab2-d729-4730-a509-235c61e9a62e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:58.878409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06bceb-c546-4daa-bf5a-7ceb0920bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:58.879697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bceb-c546-4daa-bf5a-7ceb0920bd92 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:58.880197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bceb-c546-4daa-bf5a-7ceb0920bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:58.880679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bceb-c546-4daa-bf5a-7ceb0920bd92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:58.893792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06bceb-c546-4daa-bf5a-7ceb0920bd92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-dc06bceb-c546-4daa-bf5a-7ceb0920bd92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:58.902565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:58.903494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:06:58.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:06:58.907236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 72/152] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:06:58.913792 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5058f-db5a-43d7-a632-1baf84942f86 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:59.027669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5058f-db5a-43d7-a632-1baf84942f86 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:59.067674 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6042377-bd8d-48df-947b-cc9f9c7884db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:59.068743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6042377-bd8d-48df-947b-cc9f9c7884db None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:59.069242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6042377-bd8d-48df-947b-cc9f9c7884db None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:59.069723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6042377-bd8d-48df-947b-cc9f9c7884db None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:59.070708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6042377-bd8d-48df-947b-cc9f9c7884db None admin] RBAC: Adding query filter params (name=member) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:59.071213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6042377-bd8d-48df-947b-cc9f9c7884db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:59.072828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6042377-bd8d-48df-947b-cc9f9c7884db None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:59.083043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 81/153] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:59.088950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06bceb-c546-4daa-bf5a-7ceb0920bd92 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:59.154345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:59.205214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06bceb-c546-4daa-bf5a-7ceb0920bd92 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:59.245001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a97d93-767f-4339-9dc6-969ea3171750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:59.246273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a97d93-767f-4339-9dc6-969ea3171750 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:59.246786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a97d93-767f-4339-9dc6-969ea3171750 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:59.247257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a97d93-767f-4339-9dc6-969ea3171750 None admin] PATH_INFO: `/v3/users/6120ce90d3f04398b54f4c0245ad6ada` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:59.248911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a97d93-767f-4339-9dc6-969ea3171750 None admin] RBAC: Authorizing `identity:get_user(user_id=6120ce90d3f04398b54f4c0245ad6ada)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:59.250695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a97d93-767f-4339-9dc6-969ea3171750 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:59.252785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 73/154] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:06:59 2022] GET /identity/v3/users/6120ce90d3f04398b54f4c0245ad6ada => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:59.258691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6042377-bd8d-48df-947b-cc9f9c7884db None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:59.280266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:59.381330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6042377-bd8d-48df-947b-cc9f9c7884db None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:59.421999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac2202-5c75-49f3-865f-708889c11414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:59.423178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac2202-5c75-49f3-865f-708889c11414 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:59.423706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac2202-5c75-49f3-865f-708889c11414 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:59.424246 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac2202-5c75-49f3-865f-708889c11414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:59.507183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac2202-5c75-49f3-865f-708889c11414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:59.509097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac2202-5c75-49f3-865f-708889c11414 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:59.526716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:59.622674 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 82/155] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:06:59.629045 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a97d93-767f-4339-9dc6-969ea3171750 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:59.727810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa71247-bb1d-47da-81ca-d2bdda51c3dc None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:59.728447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa71247-bb1d-47da-81ca-d2bdda51c3dc None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:59.728947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa71247-bb1d-47da-81ca-d2bdda51c3dc None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:59.730627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 83/156] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:59.744574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4f5d4-12ad-4bc3-b807-e8fb0b62fd9e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:59.745152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4f5d4-12ad-4bc3-b807-e8fb0b62fd9e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:59.745611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a97d93-767f-4339-9dc6-969ea3171750 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:59.745831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4f5d4-12ad-4bc3-b807-e8fb0b62fd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:59.770715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-05a4f5d4-12ad-4bc3-b807-e8fb0b62fd9e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:59.772294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-05a4f5d4-12ad-4bc3-b807-e8fb0b62fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:59.811295 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:59.831880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370151ca-0584-45b3-b939-4096c26b1996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:59.832699 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370151ca-0584-45b3-b939-4096c26b1996 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:59.832985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370151ca-0584-45b3-b939-4096c26b1996 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:59.833260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370151ca-0584-45b3-b939-4096c26b1996 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:59.839295 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370151ca-0584-45b3-b939-4096c26b1996 None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:59.840784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370151ca-0584-45b3-b939-4096c26b1996 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:59.846525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 74/157] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:06:59 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:59.848526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370151ca-0584-45b3-b939-4096c26b1996 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:59.915989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 84/158] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:06:59.963024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4f5d4-12ad-4bc3-b807-e8fb0b62fd9e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:59.994419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370151ca-0584-45b3-b939-4096c26b1996 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:00.048617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81290a9f-fb82-4534-9c21-f0a049bdf986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:00.049301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290a9f-fb82-4534-9c21-f0a049bdf986 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:00.049583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290a9f-fb82-4534-9c21-f0a049bdf986 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:00.049859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290a9f-fb82-4534-9c21-f0a049bdf986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:00.050733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81290a9f-fb82-4534-9c21-f0a049bdf986 None admin] RBAC: Adding query filter params (role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e, user.id=6120ce90d3f04398b54f4c0245ad6ada) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:00.051049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81290a9f-fb82-4534-9c21-f0a049bdf986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:00.052503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81290a9f-fb82-4534-9c21-f0a049bdf986 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:00.063223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 75/159] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:59 2022] GET /identity/v3/role_assignments?user.id=6120ce90d3f04398b54f4c0245ad6ada&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:00.098951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:00.182424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4f5d4-12ad-4bc3-b807-e8fb0b62fd9e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:00.238106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cfc70-0d04-4fe2-9069-48f7390cd192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:00.238981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfc70-0d04-4fe2-9069-48f7390cd192 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:00.239269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfc70-0d04-4fe2-9069-48f7390cd192 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:00.239548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfc70-0d04-4fe2-9069-48f7390cd192 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:00.253915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7ea45-76dd-46c9-aec0-20209ff67a3a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:00.254426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7ea45-76dd-46c9-aec0-20209ff67a3a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:00.254544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7ea45-76dd-46c9-aec0-20209ff67a3a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:00.255989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 76/160] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:07:00.261804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6de2c-f1f4-4c6a-a3bc-e2217b2aabc5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:00.262158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6de2c-f1f4-4c6a-a3bc-e2217b2aabc5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:00.262352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6de2c-f1f4-4c6a-a3bc-e2217b2aabc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:00.262679 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cfc70-0d04-4fe2-9069-48f7390cd192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-f11cfc70-0d04-4fe2-9069-48f7390cd192 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:00.295105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:00.296073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:00.297293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 85/161] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:00.300839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b6a6de2c-f1f4-4c6a-a3bc-e2217b2aabc5 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:00.302029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b6a6de2c-f1f4-4c6a-a3bc-e2217b2aabc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:00.305126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cfc70-0d04-4fe2-9069-48f7390cd192 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:00.466649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:00.508380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cfc70-0d04-4fe2-9069-48f7390cd192 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:00.511058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:00.520200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 77/162] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 22 10:07:00.521600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec0155-ae4a-4ff3-907e-ef5f5eaf2bfa None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:00.521887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec0155-ae4a-4ff3-907e-ef5f5eaf2bfa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:00.522164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec0155-ae4a-4ff3-907e-ef5f5eaf2bfa None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:00.523735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 78/163] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:00.531837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435e82a-369b-48dd-b3f3-6f3bf4f43793 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:00.532125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435e82a-369b-48dd-b3f3-6f3bf4f43793 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:00.532404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435e82a-369b-48dd-b3f3-6f3bf4f43793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:00.546158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6535dd-49fa-48f7-b5a0-97a23bdb935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:00.546910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6535dd-49fa-48f7-b5a0-97a23bdb935a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:00.547199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6535dd-49fa-48f7-b5a0-97a23bdb935a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:00.547479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6535dd-49fa-48f7-b5a0-97a23bdb935a None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:00.548638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6535dd-49fa-48f7-b5a0-97a23bdb935a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:00.548957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6535dd-49fa-48f7-b5a0-97a23bdb935a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:00.550549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6535dd-49fa-48f7-b5a0-97a23bdb935a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:00.560958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 86/164] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:00.568373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6535dd-49fa-48f7-b5a0-97a23bdb935a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:00.575744 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9435e82a-369b-48dd-b3f3-6f3bf4f43793 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:00.577034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9435e82a-369b-48dd-b3f3-6f3bf4f43793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:00.684016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6535dd-49fa-48f7-b5a0-97a23bdb935a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:00.723123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e308d-eed7-4bc4-bcdf-21006dafd4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:00.724007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e308d-eed7-4bc4-bcdf-21006dafd4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:00.724316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e308d-eed7-4bc4-bcdf-21006dafd4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:00.724603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e308d-eed7-4bc4-bcdf-21006dafd4b8 None admin] PATH_INFO: `/v3/users/2668ca2b24c247619bd9fb7566021a1f` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:00.725863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e308d-eed7-4bc4-bcdf-21006dafd4b8 None admin] RBAC: Authorizing `identity:get_user(user_id=2668ca2b24c247619bd9fb7566021a1f)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:00.727540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e308d-eed7-4bc4-bcdf-21006dafd4b8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:00.729359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 87/165] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:00 2022] GET /identity/v3/users/2668ca2b24c247619bd9fb7566021a1f => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:00.730202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e308d-eed7-4bc4-bcdf-21006dafd4b8 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:00.790918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:00.804345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 79/166] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:00.805431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435e82a-369b-48dd-b3f3-6f3bf4f43793 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:00.874667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e308d-eed7-4bc4-bcdf-21006dafd4b8 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:00.910988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a97f79-bf30-44fd-b64a-851b9856e562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:00.911834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a97f79-bf30-44fd-b64a-851b9856e562 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:00.912147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a97f79-bf30-44fd-b64a-851b9856e562 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:00.912426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a97f79-bf30-44fd-b64a-851b9856e562 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:00.925624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a97f79-bf30-44fd-b64a-851b9856e562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-c6a97f79-bf30-44fd-b64a-851b9856e562 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:00.933896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:00.934849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 88/167] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:00.942117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a97f79-bf30-44fd-b64a-851b9856e562 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:00.989638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435e82a-369b-48dd-b3f3-6f3bf4f43793 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:01.022927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:01.031766 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c637e17-fd22-483d-9587-8bc44a9e3512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:01.033061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c637e17-fd22-483d-9587-8bc44a9e3512 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:01.033974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c637e17-fd22-483d-9587-8bc44a9e3512 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:01.035996 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c637e17-fd22-483d-9587-8bc44a9e3512 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:01.038440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c637e17-fd22-483d-9587-8bc44a9e3512 None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:01.043884 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c637e17-fd22-483d-9587-8bc44a9e3512 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:01.048892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 80/168] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:00 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:01.054839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c637e17-fd22-483d-9587-8bc44a9e3512 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:01.137766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:01.149147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a97f79-bf30-44fd-b64a-851b9856e562 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:01.174747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c637e17-fd22-483d-9587-8bc44a9e3512 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:01.210760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c887eca-445b-44c0-8218-be791ed0e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:01.211972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c887eca-445b-44c0-8218-be791ed0e928 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:01.212443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c887eca-445b-44c0-8218-be791ed0e928 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:01.212969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c887eca-445b-44c0-8218-be791ed0e928 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:01.213927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c887eca-445b-44c0-8218-be791ed0e928 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:01.214433 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c887eca-445b-44c0-8218-be791ed0e928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:01.216030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c887eca-445b-44c0-8218-be791ed0e928 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:01.222116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13696fcf-f0b6-470a-9e0f-441e3768531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:01.222978 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13696fcf-f0b6-470a-9e0f-441e3768531b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:01.223258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13696fcf-f0b6-470a-9e0f-441e3768531b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:01.223592 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13696fcf-f0b6-470a-9e0f-441e3768531b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:01.225854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 81/169] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:01.226992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c887eca-445b-44c0-8218-be791ed0e928 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:01.241448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13696fcf-f0b6-470a-9e0f-441e3768531b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-13696fcf-f0b6-470a-9e0f-441e3768531b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:01.259007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:01.259921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 89/170] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:01.261114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13696fcf-f0b6-470a-9e0f-441e3768531b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:01.282662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:01.339501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c887eca-445b-44c0-8218-be791ed0e928 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:01.377691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa518bd-058a-4fc8-b50d-c7faf80d2217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:01.379120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa518bd-058a-4fc8-b50d-c7faf80d2217 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:01.379591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa518bd-058a-4fc8-b50d-c7faf80d2217 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:01.380052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa518bd-058a-4fc8-b50d-c7faf80d2217 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/users/2668ca2b24c247619bd9fb7566021a1f/roles/819710d7e2594120b7d6b2e9c3b5d102` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:01.382326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa518bd-058a-4fc8-b50d-c7faf80d2217 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b645eb49c354c1c96fc1d2f25352d6e, user_id=2668ca2b24c247619bd9fb7566021a1f, role_id=819710d7e2594120b7d6b2e9c3b5d102)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:01.384140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa518bd-058a-4fc8-b50d-c7faf80d2217 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:01.398572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13696fcf-f0b6-470a-9e0f-441e3768531b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:01.420837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 82/171] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:07:01 2022] PUT /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/users/2668ca2b24c247619bd9fb7566021a1f/roles/819710d7e2594120b7d6b2e9c3b5d102 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:01.421652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa518bd-058a-4fc8-b50d-c7faf80d2217 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:01.474109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32857a-1ecc-4fe4-9248-b9a71a8a8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:01.475125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32857a-1ecc-4fe4-9248-b9a71a8a8135 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:01.475403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32857a-1ecc-4fe4-9248-b9a71a8a8135 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:01.475672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32857a-1ecc-4fe4-9248-b9a71a8a8135 None admin] PATH_INFO: `/v3/users/6120ce90d3f04398b54f4c0245ad6ada` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:01.477059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32857a-1ecc-4fe4-9248-b9a71a8a8135 None admin] RBAC: Authorizing `identity:get_user(user_id=6120ce90d3f04398b54f4c0245ad6ada)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:01.478749 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32857a-1ecc-4fe4-9248-b9a71a8a8135 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:01.486678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 90/172] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:01 2022] GET /identity/v3/users/6120ce90d3f04398b54f4c0245ad6ada => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:01.488367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a6882-a6aa-4c0e-b826-72464d0d08ad None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:01.488757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a6882-a6aa-4c0e-b826-72464d0d08ad None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:01.489041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a6882-a6aa-4c0e-b826-72464d0d08ad None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:01.490722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 91/173] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:01.495226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a6882-a6aa-4c0e-b826-72464d0d08ad None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:01.551615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:01.558620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa518bd-058a-4fc8-b50d-c7faf80d2217 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:01.578206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:01.628267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff75a8-2b7f-4b17-b541-28de54d262c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:01.629827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff75a8-2b7f-4b17-b541-28de54d262c5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:01.630107 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff75a8-2b7f-4b17-b541-28de54d262c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:01.630385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff75a8-2b7f-4b17-b541-28de54d262c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:01.631183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff75a8-2b7f-4b17-b541-28de54d262c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:01.631491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff75a8-2b7f-4b17-b541-28de54d262c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:01.632913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff75a8-2b7f-4b17-b541-28de54d262c5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:01.650075 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 83/174] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:01.655933 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ac2f-d20b-496f-966b-b71e3d79e87e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:01.656209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ac2f-d20b-496f-966b-b71e3d79e87e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:01.656485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ac2f-d20b-496f-966b-b71e3d79e87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:01.686763 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a6882-a6aa-4c0e-b826-72464d0d08ad None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:01.690172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a8a7ac2f-d20b-496f-966b-b71e3d79e87e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:01.691028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a8a7ac2f-d20b-496f-966b-b71e3d79e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:01.728986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f962f-7297-4a89-8acc-6e5d9b74f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:01.730061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f962f-7297-4a89-8acc-6e5d9b74f3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:01.731451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f962f-7297-4a89-8acc-6e5d9b74f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:01.732683 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f962f-7297-4a89-8acc-6e5d9b74f3f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:01.787333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 84/175] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:01.788761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7ac2f-d20b-496f-966b-b71e3d79e87e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:01.834062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f962f-7297-4a89-8acc-6e5d9b74f3f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:01.837211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f962f-7297-4a89-8acc-6e5d9b74f3f8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:01.890872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:01.981983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7ac2f-d20b-496f-966b-b71e3d79e87e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:01.986866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:02.050514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 92/176] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:02.052037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f962f-7297-4a89-8acc-6e5d9b74f3f8 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:02.067976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70320e17-cae3-44ec-bec9-13c25a05a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:02.068894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70320e17-cae3-44ec-bec9-13c25a05a778 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.069176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70320e17-cae3-44ec-bec9-13c25a05a778 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.069448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70320e17-cae3-44ec-bec9-13c25a05a778 None admin] PATH_INFO: `/v3/users/6120ce90d3f04398b54f4c0245ad6ada` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.075460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70320e17-cae3-44ec-bec9-13c25a05a778 None admin] RBAC: Authorizing `identity:get_user(user_id=6120ce90d3f04398b54f4c0245ad6ada)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:02.077066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70320e17-cae3-44ec-bec9-13c25a05a778 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:02.078917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 85/177] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:01 2022] GET /identity/v3/users/6120ce90d3f04398b54f4c0245ad6ada => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:02.079748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70320e17-cae3-44ec-bec9-13c25a05a778 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:02.178846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f962f-7297-4a89-8acc-6e5d9b74f3f8 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:02.204013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:02.217238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231fbf0-a9a8-4e55-b28e-511fc0dfce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:02.218490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fbf0-a9a8-4e55-b28e-511fc0dfce7d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.219015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fbf0-a9a8-4e55-b28e-511fc0dfce7d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.219318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70320e17-cae3-44ec-bec9-13c25a05a778 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:02.220000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fbf0-a9a8-4e55-b28e-511fc0dfce7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.232513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231fbf0-a9a8-4e55-b28e-511fc0dfce7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-9231fbf0-a9a8-4e55-b28e-511fc0dfce7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:02.241252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:02.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:02.243062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:02.245958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 93/178] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:02.247171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231fbf0-a9a8-4e55-b28e-511fc0dfce7d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:02.256714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3afe77-9934-47b6-8635-cc56af16aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:02.257646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3afe77-9934-47b6-8635-cc56af16aac7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.257931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3afe77-9934-47b6-8635-cc56af16aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.258208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3afe77-9934-47b6-8635-cc56af16aac7 None admin] PATH_INFO: `/v3/projects/e4de86cd35884816ab30ff5bae571ef9` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.259704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3afe77-9934-47b6-8635-cc56af16aac7 None admin] RBAC: Authorizing `identity:get_project(project_id=e4de86cd35884816ab30ff5bae571ef9)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:02.261441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3afe77-9934-47b6-8635-cc56af16aac7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:02.263100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 86/179] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:02 2022] GET /identity/v3/projects/e4de86cd35884816ab30ff5bae571ef9 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:02.269463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73c54-fdd7-4fd2-b1bb-a1a9c5e1b08d None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.269754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73c54-fdd7-4fd2-b1bb-a1a9c5e1b08d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.270729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73c54-fdd7-4fd2-b1bb-a1a9c5e1b08d None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.272112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 87/180] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:02.273180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e73c54-fdd7-4fd2-b1bb-a1a9c5e1b08d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:02.319815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:02.361901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231fbf0-a9a8-4e55-b28e-511fc0dfce7d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:02.392796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e73c54-fdd7-4fd2-b1bb-a1a9c5e1b08d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:02.398840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601dac-cf1e-4446-8793-2375d8c87620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:02.399503 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601dac-cf1e-4446-8793-2375d8c87620 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.399784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601dac-cf1e-4446-8793-2375d8c87620 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.400057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601dac-cf1e-4446-8793-2375d8c87620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.430902 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19996eea-8e67-4bd0-bc65-44e8c49a1258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:02.431697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996eea-8e67-4bd0-bc65-44e8c49a1258 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.432006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996eea-8e67-4bd0-bc65-44e8c49a1258 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.432456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996eea-8e67-4bd0-bc65-44e8c49a1258 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.433217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19996eea-8e67-4bd0-bc65-44e8c49a1258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:02.433469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19996eea-8e67-4bd0-bc65-44e8c49a1258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:02.434901 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19996eea-8e67-4bd0-bc65-44e8c49a1258 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:02.448091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 88/181] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:02.448770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19996eea-8e67-4bd0-bc65-44e8c49a1258 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:02.458936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:02.482257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67601dac-cf1e-4446-8793-2375d8c87620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:02.483681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67601dac-cf1e-4446-8793-2375d8c87620 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:02.552035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:02.556041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19996eea-8e67-4bd0-bc65-44e8c49a1258 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:02.602192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514f7ab-bc5b-4d27-b48f-8dac8397d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:02.603430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514f7ab-bc5b-4d27-b48f-8dac8397d245 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.604191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514f7ab-bc5b-4d27-b48f-8dac8397d245 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.604721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514f7ab-bc5b-4d27-b48f-8dac8397d245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.605799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514f7ab-bc5b-4d27-b48f-8dac8397d245 None admin] RBAC: Adding query filter params (role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, scope.project.id=e4de86cd35884816ab30ff5bae571ef9, user.id=6120ce90d3f04398b54f4c0245ad6ada) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:02.606309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514f7ab-bc5b-4d27-b48f-8dac8397d245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:02.607476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 94/182] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:02.608776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514f7ab-bc5b-4d27-b48f-8dac8397d245 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:02.608928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357e297-ae9e-4805-b622-1fbcd5193aab None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.609233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357e297-ae9e-4805-b622-1fbcd5193aab None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.609515 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357e297-ae9e-4805-b622-1fbcd5193aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.626548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 89/183] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:02 2022] GET /identity/v3/role_assignments?user.id=6120ce90d3f04398b54f4c0245ad6ada&scope.project.id=e4de86cd35884816ab30ff5bae571ef9&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:02.626548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381bbad-f0b7-4f31-af68-727b73f9fb06 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.626548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381bbad-f0b7-4f31-af68-727b73f9fb06 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.626548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381bbad-f0b7-4f31-af68-727b73f9fb06 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.626548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 90/184] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:02.626548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381bbad-f0b7-4f31-af68-727b73f9fb06 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:02.650168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-f357e297-ae9e-4805-b622-1fbcd5193aab None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:02.651766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f357e297-ae9e-4805-b622-1fbcd5193aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:02.757589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381bbad-f0b7-4f31-af68-727b73f9fb06 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:02.763338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 95/185] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:02.766845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357e297-ae9e-4805-b622-1fbcd5193aab None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:02.787171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:02.827211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec77665-7036-4cf1-acad-5cd82077a02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:02.828356 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77665-7036-4cf1-acad-5cd82077a02c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.828634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77665-7036-4cf1-acad-5cd82077a02c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.828908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77665-7036-4cf1-acad-5cd82077a02c None admin] PATH_INFO: `/v3/users/468ae0b1f95941b3a170a3f384446727` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.845196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec77665-7036-4cf1-acad-5cd82077a02c None admin] RBAC: Authorizing `identity:get_user(user_id=468ae0b1f95941b3a170a3f384446727)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:02.847056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec77665-7036-4cf1-acad-5cd82077a02c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:02.848476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 91/186] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:02 2022] GET /identity/v3/users/468ae0b1f95941b3a170a3f384446727 => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:02.849898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689d92-4ef0-4728-8ec7-7603d4e8ad03 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.850160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689d92-4ef0-4728-8ec7-7603d4e8ad03 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.850429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689d92-4ef0-4728-8ec7-7603d4e8ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.871206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e5689d92-4ef0-4728-8ec7-7603d4e8ad03 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:02.872569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e5689d92-4ef0-4728-8ec7-7603d4e8ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:02.898453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:02.915682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357e297-ae9e-4805-b622-1fbcd5193aab None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:02.958376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dbfdf-a31b-416a-80a8-7469bbd200c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:02.959318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbfdf-a31b-416a-80a8-7469bbd200c7 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:02.959607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbfdf-a31b-416a-80a8-7469bbd200c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:02.959886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbfdf-a31b-416a-80a8-7469bbd200c7 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:02.961389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 92/187] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:02.961535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dbfdf-a31b-416a-80a8-7469bbd200c7 None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:02.962025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5689d92-4ef0-4728-8ec7-7603d4e8ad03 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:02.966782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dbfdf-a31b-416a-80a8-7469bbd200c7 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:02.966782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 96/188] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:02 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:02.966782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dbfdf-a31b-416a-80a8-7469bbd200c7 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:03.064199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:03.076448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5689d92-4ef0-4728-8ec7-7603d4e8ad03 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:03.090170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dbfdf-a31b-416a-80a8-7469bbd200c7 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:03.126731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14267b-78dc-4253-a3ff-b266acdbef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:03.127596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14267b-78dc-4253-a3ff-b266acdbef48 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.127943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14267b-78dc-4253-a3ff-b266acdbef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.128288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14267b-78dc-4253-a3ff-b266acdbef48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.129636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14267b-78dc-4253-a3ff-b266acdbef48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:03.131245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14267b-78dc-4253-a3ff-b266acdbef48 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:03.133152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 93/189] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:03.133831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14267b-78dc-4253-a3ff-b266acdbef48 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:03.134876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d1807-f922-4afa-b426-7708c7c2ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:03.135545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d1807-f922-4afa-b426-7708c7c2ebb1 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.135830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d1807-f922-4afa-b426-7708c7c2ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.136106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d1807-f922-4afa-b426-7708c7c2ebb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.162658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:03.224292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d1807-f922-4afa-b426-7708c7c2ebb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:03.225946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d1807-f922-4afa-b426-7708c7c2ebb1 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:03.258665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14267b-78dc-4253-a3ff-b266acdbef48 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:03.300279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb711e-e2a3-46aa-8938-6e54bf281995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:03.300911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb711e-e2a3-46aa-8938-6e54bf281995 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.301189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb711e-e2a3-46aa-8938-6e54bf281995 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.301459 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb711e-e2a3-46aa-8938-6e54bf281995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.302299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb711e-e2a3-46aa-8938-6e54bf281995 None admin] RBAC: Adding query filter params (role.id=26c081183cd3490c977d961b36b9cee4, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e, user.id=6120ce90d3f04398b54f4c0245ad6ada) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:03.302653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb711e-e2a3-46aa-8938-6e54bf281995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:03.304130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb711e-e2a3-46aa-8938-6e54bf281995 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:03.322850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 94/190] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:03 2022] GET /identity/v3/role_assignments?user.id=6120ce90d3f04398b54f4c0245ad6ada&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=26c081183cd3490c977d961b36b9cee4 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:03.322850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb711e-e2a3-46aa-8938-6e54bf281995 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:03.324478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:03.354161 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 97/191] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:03.355127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d1807-f922-4afa-b426-7708c7c2ebb1 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:03.445609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:03.474124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb711e-e2a3-46aa-8938-6e54bf281995 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:03.484537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d1807-f922-4afa-b426-7708c7c2ebb1 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:03.520701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78afdc-fae3-4b79-99bd-b9fc489b686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:03.521522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78afdc-fae3-4b79-99bd-b9fc489b686a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.521804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78afdc-fae3-4b79-99bd-b9fc489b686a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.522073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78afdc-fae3-4b79-99bd-b9fc489b686a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.529345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd81828-a1d4-48c6-a685-faf2e0a80479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:03.530243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd81828-a1d4-48c6-a685-faf2e0a80479 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.530630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd81828-a1d4-48c6-a685-faf2e0a80479 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.530891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd81828-a1d4-48c6-a685-faf2e0a80479 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.531573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd81828-a1d4-48c6-a685-faf2e0a80479 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:03.533108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd81828-a1d4-48c6-a685-faf2e0a80479 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:03.539151 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78afdc-fae3-4b79-99bd-b9fc489b686a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0c78afdc-fae3-4b79-99bd-b9fc489b686a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:03.549781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:03.551149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 95/192] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:03.552259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78afdc-fae3-4b79-99bd-b9fc489b686a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:03.562394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 98/193] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:07:03 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:07:03.564495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd81828-a1d4-48c6-a685-faf2e0a80479 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:03.619948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:03.713457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78afdc-fae3-4b79-99bd-b9fc489b686a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:03.737787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd81828-a1d4-48c6-a685-faf2e0a80479 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:03.762185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a3df3-211f-4acf-b580-802b5b0036a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:03.763450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a3df3-211f-4acf-b580-802b5b0036a4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.764012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a3df3-211f-4acf-b580-802b5b0036a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.764448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a3df3-211f-4acf-b580-802b5b0036a4 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.766124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a3df3-211f-4acf-b580-802b5b0036a4 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:03.768660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a3df3-211f-4acf-b580-802b5b0036a4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:03.776521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 96/194] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:03 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:03.777538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a3df3-211f-4acf-b580-802b5b0036a4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:03.792310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ba6b2-a824-4d1d-9846-324fbd4e2648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:03.793350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba6b2-a824-4d1d-9846-324fbd4e2648 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.793350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba6b2-a824-4d1d-9846-324fbd4e2648 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.793577 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba6b2-a824-4d1d-9846-324fbd4e2648 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.794283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba6b2-a824-4d1d-9846-324fbd4e2648 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:03.794620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba6b2-a824-4d1d-9846-324fbd4e2648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:03.795656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:03.796093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba6b2-a824-4d1d-9846-324fbd4e2648 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:03.805624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 99/195] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:03.812552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ba6b2-a824-4d1d-9846-324fbd4e2648 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:03.920102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a3df3-211f-4acf-b580-802b5b0036a4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:03.932814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:03.940446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ba6b2-a824-4d1d-9846-324fbd4e2648 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:03.956632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830ccf8-0d5f-4204-9c65-be56cabd8685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:03.957399 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830ccf8-0d5f-4204-9c65-be56cabd8685 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.957636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830ccf8-0d5f-4204-9c65-be56cabd8685 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.957901 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830ccf8-0d5f-4204-9c65-be56cabd8685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.958780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830ccf8-0d5f-4204-9c65-be56cabd8685 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=89fcb966a1644945aee124d621ce16dd, user.id=468ae0b1f95941b3a170a3f384446727) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:03.959085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830ccf8-0d5f-4204-9c65-be56cabd8685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:03.960552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830ccf8-0d5f-4204-9c65-be56cabd8685 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:03.967277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 97/196] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:03 2022] GET /identity/v3/role_assignments?user.id=468ae0b1f95941b3a170a3f384446727&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:03.969879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967f5d4-1490-47b0-bd8c-1fd2de0995e7 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.970165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967f5d4-1490-47b0-bd8c-1fd2de0995e7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.970438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967f5d4-1490-47b0-bd8c-1fd2de0995e7 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.972308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 98/197] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:03.978453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8845c9-446d-4f29-984c-781bddf930db None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.978790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8845c9-446d-4f29-984c-781bddf930db None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.979061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8845c9-446d-4f29-984c-781bddf930db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.989517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b1b72-a613-4a95-ab63-c3a24efa6e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:03.990493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b1b72-a613-4a95-ab63-c3a24efa6e59 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:03.990807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b1b72-a613-4a95-ab63-c3a24efa6e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:03.991080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b1b72-a613-4a95-ab63-c3a24efa6e59 None admin] PATH_INFO: `/v3/users/468ae0b1f95941b3a170a3f384446727` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:03.995867 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b1b72-a613-4a95-ab63-c3a24efa6e59 None admin] RBAC: Authorizing `identity:get_user(user_id=468ae0b1f95941b3a170a3f384446727)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:03.997468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b1b72-a613-4a95-ab63-c3a24efa6e59 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:03.999426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 100/198] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:03 2022] GET /identity/v3/users/468ae0b1f95941b3a170a3f384446727 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:04.005508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b1b72-a613-4a95-ab63-c3a24efa6e59 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:04.016085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fa8845c9-446d-4f29-984c-781bddf930db None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:04.017636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fa8845c9-446d-4f29-984c-781bddf930db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:04.114483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 99/199] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:04.139456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8845c9-446d-4f29-984c-781bddf930db None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:04.142864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:04.165798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b1b72-a613-4a95-ab63-c3a24efa6e59 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:04.208042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d6877-8a88-4915-807c-79966e178bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:04.208720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d6877-8a88-4915-807c-79966e178bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:04.209005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d6877-8a88-4915-807c-79966e178bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:04.209280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d6877-8a88-4915-807c-79966e178bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:04.267265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:04.306578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8845c9-446d-4f29-984c-781bddf930db None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:04.342065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d6877-8a88-4915-807c-79966e178bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:04.343616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d6877-8a88-4915-807c-79966e178bf8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:04.387755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4c809-65a0-40f1-82ef-d4a5ef4b0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:04.389368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4c809-65a0-40f1-82ef-d4a5ef4b0bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:04.389922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4c809-65a0-40f1-82ef-d4a5ef4b0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:04.391064 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4c809-65a0-40f1-82ef-d4a5ef4b0bc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:04.413358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4c809-65a0-40f1-82ef-d4a5ef4b0bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-80c4c809-65a0-40f1-82ef-d4a5ef4b0bc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:04.428281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:04.429236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:04.430068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:04.434080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 100/200] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:04.441567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4c809-65a0-40f1-82ef-d4a5ef4b0bc8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:04.554691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 101/201] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:04.557761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d6877-8a88-4915-807c-79966e178bf8 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:04.585613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:04.649614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4c809-65a0-40f1-82ef-d4a5ef4b0bc8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:04.659026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:04.694775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d6877-8a88-4915-807c-79966e178bf8 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:04.724769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd97c44-f8bf-48dd-b509-7c9956284487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:04.725494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd97c44-f8bf-48dd-b509-7c9956284487 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:04.725802 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd97c44-f8bf-48dd-b509-7c9956284487 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:04.726034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd97c44-f8bf-48dd-b509-7c9956284487 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:04.726866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd97c44-f8bf-48dd-b509-7c9956284487 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:04.727403 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd97c44-f8bf-48dd-b509-7c9956284487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:04.728596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd97c44-f8bf-48dd-b509-7c9956284487 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:04.744993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570152fa-93e6-4242-bae4-972680a5d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:04.746249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570152fa-93e6-4242-bae4-972680a5d920 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:04.748464 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570152fa-93e6-4242-bae4-972680a5d920 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:04.748972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570152fa-93e6-4242-bae4-972680a5d920 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:04.751937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570152fa-93e6-4242-bae4-972680a5d920 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:04.753691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570152fa-93e6-4242-bae4-972680a5d920 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:04.754886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 101/202] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:04.756969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 102/203] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:04 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:04.761804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd97c44-f8bf-48dd-b509-7c9956284487 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:04.765919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570152fa-93e6-4242-bae4-972680a5d920 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:04.887214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd97c44-f8bf-48dd-b509-7c9956284487 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:04.917932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:04.937945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba53c4-b53c-4ecb-a240-165dc14bdc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:04.939297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba53c4-b53c-4ecb-a240-165dc14bdc48 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:04.939883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba53c4-b53c-4ecb-a240-165dc14bdc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:04.940421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba53c4-b53c-4ecb-a240-165dc14bdc48 None admin] PATH_INFO: `/v3/users/2668ca2b24c247619bd9fb7566021a1f` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:04.942822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba53c4-b53c-4ecb-a240-165dc14bdc48 None admin] RBAC: Authorizing `identity:get_user(user_id=2668ca2b24c247619bd9fb7566021a1f)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:04.944497 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba53c4-b53c-4ecb-a240-165dc14bdc48 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:04.949789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 102/204] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:04 2022] GET /identity/v3/users/2668ca2b24c247619bd9fb7566021a1f => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:04.955545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba53c4-b53c-4ecb-a240-165dc14bdc48 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:05.031489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570152fa-93e6-4242-bae4-972680a5d920 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:05.095272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276736c-2936-4f96-b1f0-7392a4845d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:05.096346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276736c-2936-4f96-b1f0-7392a4845d28 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:05.096878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276736c-2936-4f96-b1f0-7392a4845d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:05.097002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba53c4-b53c-4ecb-a240-165dc14bdc48 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:05.097475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276736c-2936-4f96-b1f0-7392a4845d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:05.098582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276736c-2936-4f96-b1f0-7392a4845d28 None admin] RBAC: Adding query filter params (role.id=26c081183cd3490c977d961b36b9cee4, scope.project.id=89fcb966a1644945aee124d621ce16dd, user.id=468ae0b1f95941b3a170a3f384446727) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:05.099102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276736c-2936-4f96-b1f0-7392a4845d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:05.100838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276736c-2936-4f96-b1f0-7392a4845d28 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:05.110529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:05.120278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 103/205] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:04 2022] GET /identity/v3/role_assignments?user.id=468ae0b1f95941b3a170a3f384446727&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=26c081183cd3490c977d961b36b9cee4 => generated 259 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:05.149168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5a476-c6fb-46fd-882d-e27d93bb472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:05.149777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5a476-c6fb-46fd-882d-e27d93bb472c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:05.150069 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5a476-c6fb-46fd-882d-e27d93bb472c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:05.150350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5a476-c6fb-46fd-882d-e27d93bb472c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:05.239966 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:05.256007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5a476-c6fb-46fd-882d-e27d93bb472c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:05.257520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5a476-c6fb-46fd-882d-e27d93bb472c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:05.385488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 103/206] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:07:05.391191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276736c-2936-4f96-b1f0-7392a4845d28 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:05.535015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276736c-2936-4f96-b1f0-7392a4845d28 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:05.582415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7ac5b-1991-4944-ae80-b14684c825e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:05.584370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ac5b-1991-4944-ae80-b14684c825e7 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:05.584893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ac5b-1991-4944-ae80-b14684c825e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:05.585424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ac5b-1991-4944-ae80-b14684c825e7 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:05.591389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7ac5b-1991-4944-ae80-b14684c825e7 None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:05.593363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7ac5b-1991-4944-ae80-b14684c825e7 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:05.595719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 104/207] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:05 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:05.602185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5a476-c6fb-46fd-882d-e27d93bb472c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:05.785323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:05.792256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5a476-c6fb-46fd-882d-e27d93bb472c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:05.847189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef22eca-fb16-4688-9940-6f1c3a584eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:05.847867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef22eca-fb16-4688-9940-6f1c3a584eed None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:05.848151 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef22eca-fb16-4688-9940-6f1c3a584eed None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:05.848428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef22eca-fb16-4688-9940-6f1c3a584eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:05.849288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef22eca-fb16-4688-9940-6f1c3a584eed None admin] RBAC: Adding query filter params (role.id=819710d7e2594120b7d6b2e9c3b5d102, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e, user.id=2668ca2b24c247619bd9fb7566021a1f) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:05.849600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef22eca-fb16-4688-9940-6f1c3a584eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:05.851145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef22eca-fb16-4688-9940-6f1c3a584eed None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:05.861154 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 104/208] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:05 2022] GET /identity/v3/role_assignments?user.id=2668ca2b24c247619bd9fb7566021a1f&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=819710d7e2594120b7d6b2e9c3b5d102 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:06.166671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a634d-d49e-4bc9-82cd-6cd0cf7a905d None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:06.167041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a634d-d49e-4bc9-82cd-6cd0cf7a905d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:06.167223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a634d-d49e-4bc9-82cd-6cd0cf7a905d None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:06.168939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 105/209] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:06.174814 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f30a79-d76c-4c2d-b810-0fc8b6b9ebec None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:06.175131 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f30a79-d76c-4c2d-b810-0fc8b6b9ebec None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:06.175367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f30a79-d76c-4c2d-b810-0fc8b6b9ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:06.193470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c4f30a79-d76c-4c2d-b810-0fc8b6b9ebec None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:06.195064 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c4f30a79-d76c-4c2d-b810-0fc8b6b9ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:06.271495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 105/210] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:06.287312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec912541-7683-48e9-a224-cbd2e7b406c7 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:06.287914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec912541-7683-48e9-a224-cbd2e7b406c7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:06.288376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec912541-7683-48e9-a224-cbd2e7b406c7 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:06.289972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 106/211] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:06.296236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce70a4-4fb5-4774-8d28-d716e59d1392 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:06.296826 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce70a4-4fb5-4774-8d28-d716e59d1392 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:06.297299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce70a4-4fb5-4774-8d28-d716e59d1392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:06.298684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec912541-7683-48e9-a224-cbd2e7b406c7 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:06.317423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e1ce70a4-4fb5-4774-8d28-d716e59d1392 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:06.318748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e1ce70a4-4fb5-4774-8d28-d716e59d1392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:06.391640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:06.413464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 106/212] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:06.438869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce70a4-4fb5-4774-8d28-d716e59d1392 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:06.442993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec912541-7683-48e9-a224-cbd2e7b406c7 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:06.458538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:06.484901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f056d-c793-4069-b369-2b1ad424684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:06.485953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f056d-c793-4069-b369-2b1ad424684a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:06.486304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f056d-c793-4069-b369-2b1ad424684a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:06.486680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f056d-c793-4069-b369-2b1ad424684a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:06.487981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f056d-c793-4069-b369-2b1ad424684a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:06.489693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f056d-c793-4069-b369-2b1ad424684a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:06.492041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 107/213] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:06.497506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f056d-c793-4069-b369-2b1ad424684a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:06.549513 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce70a4-4fb5-4774-8d28-d716e59d1392 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:06.585991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4283e7e-3620-43d7-b078-3a0f9f904fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:06.586851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283e7e-3620-43d7-b078-3a0f9f904fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:06.587128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283e7e-3620-43d7-b078-3a0f9f904fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:06.587556 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283e7e-3620-43d7-b078-3a0f9f904fd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:06.601172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4283e7e-3620-43d7-b078-3a0f9f904fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:06.605519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f056d-c793-4069-b369-2b1ad424684a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a4283e7e-3620-43d7-b078-3a0f9f904fd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:06.609481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:06.610916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:06.611758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 107/214] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:06.612431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421df100-4550-494e-b5f8-55f277f03ad2 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:06.612499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421df100-4550-494e-b5f8-55f277f03ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:06.613397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421df100-4550-494e-b5f8-55f277f03ad2 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:06.623338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 108/215] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:06.623338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421df100-4550-494e-b5f8-55f277f03ad2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:06.655533 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e48117-4050-4a0c-bca4-577fd1d05e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:06.656536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e48117-4050-4a0c-bca4-577fd1d05e30 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:06.656823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e48117-4050-4a0c-bca4-577fd1d05e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:06.657364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e48117-4050-4a0c-bca4-577fd1d05e30 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:06.658100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e48117-4050-4a0c-bca4-577fd1d05e30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:06.660632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e48117-4050-4a0c-bca4-577fd1d05e30 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:06.671707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:06.698625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 108/216] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:07:06 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:07:06.698625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c910b10-6c74-42b4-adb5-6492b2f34ad0 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:06.698625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c910b10-6c74-42b4-adb5-6492b2f34ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:06.698625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c910b10-6c74-42b4-adb5-6492b2f34ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:06.711037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-6c910b10-6c74-42b4-adb5-6492b2f34ad0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:06.712290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-6c910b10-6c74-42b4-adb5-6492b2f34ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:06.735724 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:06.766354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421df100-4550-494e-b5f8-55f277f03ad2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:06.809977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 109/217] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:06.816020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bddbf-e96b-41d7-a332-84ad29c0cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:06.816993 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bddbf-e96b-41d7-a332-84ad29c0cef2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:06.818112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bddbf-e96b-41d7-a332-84ad29c0cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:06.818112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bddbf-e96b-41d7-a332-84ad29c0cef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:06.818785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bddbf-e96b-41d7-a332-84ad29c0cef2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:06.819101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bddbf-e96b-41d7-a332-84ad29c0cef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:06.820611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bddbf-e96b-41d7-a332-84ad29c0cef2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:06.831128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 109/218] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:06.836909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c910b10-6c74-42b4-adb5-6492b2f34ad0 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:06.837407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bddbf-e96b-41d7-a332-84ad29c0cef2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:06.960854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c910b10-6c74-42b4-adb5-6492b2f34ad0 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:06.965741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bddbf-e96b-41d7-a332-84ad29c0cef2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:06.989983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:07.009208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f01098-60ab-4dab-9f5c-f65e8111ebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:07.010217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f01098-60ab-4dab-9f5c-f65e8111ebc4 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:07.010561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f01098-60ab-4dab-9f5c-f65e8111ebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:07.010792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e4af7-2b7b-4b82-8255-d174081c9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:07.010922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f01098-60ab-4dab-9f5c-f65e8111ebc4 None admin] PATH_INFO: `/v3/users/a57046a0f9c049c6b7bf02f511ba44a7` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:07.011607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e4af7-2b7b-4b82-8255-d174081c9a4b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:07.011892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e4af7-2b7b-4b82-8255-d174081c9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:07.012220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e4af7-2b7b-4b82-8255-d174081c9a4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:07.021943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:07.028304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e4af7-2b7b-4b82-8255-d174081c9a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:07.032194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f01098-60ab-4dab-9f5c-f65e8111ebc4 None admin] RBAC: Authorizing `identity:get_user(user_id=a57046a0f9c049c6b7bf02f511ba44a7)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:07.034200 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f01098-60ab-4dab-9f5c-f65e8111ebc4 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:07.036324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 110/219] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:06 2022] GET /identity/v3/users/a57046a0f9c049c6b7bf02f511ba44a7 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-e87e4af7-2b7b-4b82-8255-d174081c9a4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:07.037680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:07.041767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:07.042907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 110/220] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:07:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:07.043591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f01098-60ab-4dab-9f5c-f65e8111ebc4 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:07.046481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e4af7-2b7b-4b82-8255-d174081c9a4b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:07.181737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f01098-60ab-4dab-9f5c-f65e8111ebc4 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:07.191788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e4af7-2b7b-4b82-8255-d174081c9a4b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:07.220493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76868e50-ded3-4aad-b3b9-c96f0cc54c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:07.221568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868e50-ded3-4aad-b3b9-c96f0cc54c8b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:07.222093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868e50-ded3-4aad-b3b9-c96f0cc54c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:07.222715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868e50-ded3-4aad-b3b9-c96f0cc54c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:07.235186 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e982d24-7645-4b2a-973b-a1a159bf0cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:07.236341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e982d24-7645-4b2a-973b-a1a159bf0cef None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:07.236639 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e982d24-7645-4b2a-973b-a1a159bf0cef None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:07.236920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e982d24-7645-4b2a-973b-a1a159bf0cef None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:07.237802 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e982d24-7645-4b2a-973b-a1a159bf0cef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:07.238116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e982d24-7645-4b2a-973b-a1a159bf0cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:07.240063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e982d24-7645-4b2a-973b-a1a159bf0cef None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:07.252156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 111/221] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:07.261907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e982d24-7645-4b2a-973b-a1a159bf0cef None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:07.294531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:07.330801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76868e50-ded3-4aad-b3b9-c96f0cc54c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:07.333494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76868e50-ded3-4aad-b3b9-c96f0cc54c8b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:07.342929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:07.386558 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e982d24-7645-4b2a-973b-a1a159bf0cef None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:07.423369 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a716f-e14e-42b2-ad14-fb36c513d5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:07.424378 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a716f-e14e-42b2-ad14-fb36c513d5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:07.424751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a716f-e14e-42b2-ad14-fb36c513d5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:07.425111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a716f-e14e-42b2-ad14-fb36c513d5c2 None admin] PATH_INFO: `/v3/users/468ae0b1f95941b3a170a3f384446727` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:07.427201 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a716f-e14e-42b2-ad14-fb36c513d5c2 None admin] RBAC: Authorizing `identity:get_user(user_id=468ae0b1f95941b3a170a3f384446727)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:07.428754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a716f-e14e-42b2-ad14-fb36c513d5c2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:07.430913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 112/222] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:07 2022] GET /identity/v3/users/468ae0b1f95941b3a170a3f384446727 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:07.437874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a716f-e14e-42b2-ad14-fb36c513d5c2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:07.554132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 111/223] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:07.560667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76868e50-ded3-4aad-b3b9-c96f0cc54c8b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:07.643382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a716f-e14e-42b2-ad14-fb36c513d5c2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:07.676488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:07.684515 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:07.685169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cf028-279e-4320-a78c-9a0580fb9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:07.686480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf028-279e-4320-a78c-9a0580fb9c03 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:07.687056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf028-279e-4320-a78c-9a0580fb9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:07.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf028-279e-4320-a78c-9a0580fb9c03 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:07.689409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cf028-279e-4320-a78c-9a0580fb9c03 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:07.691148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cf028-279e-4320-a78c-9a0580fb9c03 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:07.693138 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 113/224] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:07 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:07.699140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1aab45-302b-4cf9-a7c9-3bf9a3ad6636 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:07.699852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1aab45-302b-4cf9-a7c9-3bf9a3ad6636 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:07.700335 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1aab45-302b-4cf9-a7c9-3bf9a3ad6636 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:07.702102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 114/225] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:07.703096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1aab45-302b-4cf9-a7c9-3bf9a3ad6636 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:07.709361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76868e50-ded3-4aad-b3b9-c96f0cc54c8b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:07.745522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045f01-57f4-4d6f-ae4a-955655cb056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:07.746408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045f01-57f4-4d6f-ae4a-955655cb056a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:07.746727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045f01-57f4-4d6f-ae4a-955655cb056a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:07.747001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045f01-57f4-4d6f-ae4a-955655cb056a None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:07.748257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21045f01-57f4-4d6f-ae4a-955655cb056a None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:07.750080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21045f01-57f4-4d6f-ae4a-955655cb056a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:07.756658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 112/226] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:07 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:07.756658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a27a8-f2a7-42fc-a547-d376f97565ad None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:07.756658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a27a8-f2a7-42fc-a547-d376f97565ad None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:07.756658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a27a8-f2a7-42fc-a547-d376f97565ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:07.772710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-aa3a27a8-f2a7-42fc-a547-d376f97565ad None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:07.773908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-aa3a27a8-f2a7-42fc-a547-d376f97565ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:07.827642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1aab45-302b-4cf9-a7c9-3bf9a3ad6636 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:07.849858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 113/227] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:07.850789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a27a8-f2a7-42fc-a547-d376f97565ad None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:07.864942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbc323-0d25-42f3-8ca6-e6495a50d73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:07.866197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbc323-0d25-42f3-8ca6-e6495a50d73e None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:07.866794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbc323-0d25-42f3-8ca6-e6495a50d73e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:07.867387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbc323-0d25-42f3-8ca6-e6495a50d73e None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd/users/468ae0b1f95941b3a170a3f384446727/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:07.869649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbc323-0d25-42f3-8ca6-e6495a50d73e None admin] RBAC: Authorizing `identity:create_grant(project_id=89fcb966a1644945aee124d621ce16dd, user_id=468ae0b1f95941b3a170a3f384446727, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:07.871477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbc323-0d25-42f3-8ca6-e6495a50d73e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:07.891691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 115/228] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:07:07 2022] PUT /identity/v3/projects/89fcb966a1644945aee124d621ce16dd/users/468ae0b1f95941b3a170a3f384446727/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:07.892719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbc323-0d25-42f3-8ca6-e6495a50d73e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:07.968159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:08.014528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a27a8-f2a7-42fc-a547-d376f97565ad None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:08.020999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:08.047692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3428276-2f66-4dfd-93a2-0bc89dd7faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:08.048371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3428276-2f66-4dfd-93a2-0bc89dd7faf2 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:08.048657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3428276-2f66-4dfd-93a2-0bc89dd7faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:08.048909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3428276-2f66-4dfd-93a2-0bc89dd7faf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:08.049764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3428276-2f66-4dfd-93a2-0bc89dd7faf2 None admin] RBAC: Adding query filter params (role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, scope.project.id=89fcb966a1644945aee124d621ce16dd, user.id=a57046a0f9c049c6b7bf02f511ba44a7) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:08.050162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3428276-2f66-4dfd-93a2-0bc89dd7faf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:08.051593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3428276-2f66-4dfd-93a2-0bc89dd7faf2 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:08.058178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 114/229] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:07 2022] GET /identity/v3/role_assignments?user.id=a57046a0f9c049c6b7bf02f511ba44a7&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:08.115069 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbc323-0d25-42f3-8ca6-e6495a50d73e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:08.168976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f902b-0c26-4abc-a2c9-a150a4027b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:08.169859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f902b-0c26-4abc-a2c9-a150a4027b32 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:08.170143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f902b-0c26-4abc-a2c9-a150a4027b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:08.170411 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f902b-0c26-4abc-a2c9-a150a4027b32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:08.186327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f902b-0c26-4abc-a2c9-a150a4027b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-2f0f902b-0c26-4abc-a2c9-a150a4027b32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:08.195162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:08.196144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:08.196981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 116/230] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:08.203715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3428276-2f66-4dfd-93a2-0bc89dd7faf2 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:08.315956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3428276-2f66-4dfd-93a2-0bc89dd7faf2 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:08.351760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225822dd-3f3f-443f-b235-2f2ee8e36f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:08.352832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225822dd-3f3f-443f-b235-2f2ee8e36f80 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:08.353316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225822dd-3f3f-443f-b235-2f2ee8e36f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:08.353798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225822dd-3f3f-443f-b235-2f2ee8e36f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:08.354826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225822dd-3f3f-443f-b235-2f2ee8e36f80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:08.355340 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225822dd-3f3f-443f-b235-2f2ee8e36f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:08.356963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225822dd-3f3f-443f-b235-2f2ee8e36f80 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:08.367188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 115/231] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:08.375707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f902b-0c26-4abc-a2c9-a150a4027b32 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:08.523987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f902b-0c26-4abc-a2c9-a150a4027b32 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:08.548888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:08.572176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2825cb-d776-424e-81e9-b8af7cdcda39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:08.573091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2825cb-d776-424e-81e9-b8af7cdcda39 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:08.573365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2825cb-d776-424e-81e9-b8af7cdcda39 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:08.573634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2825cb-d776-424e-81e9-b8af7cdcda39 None admin] PATH_INFO: `/v3/users/468ae0b1f95941b3a170a3f384446727` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:08.574916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2825cb-d776-424e-81e9-b8af7cdcda39 None admin] RBAC: Authorizing `identity:get_user(user_id=468ae0b1f95941b3a170a3f384446727)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:08.576529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2825cb-d776-424e-81e9-b8af7cdcda39 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:08.578197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 117/232] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:08 2022] GET /identity/v3/users/468ae0b1f95941b3a170a3f384446727 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:08.583966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225822dd-3f3f-443f-b235-2f2ee8e36f80 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:08.593265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:08.723545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225822dd-3f3f-443f-b235-2f2ee8e36f80 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:08.758364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b362f57-52e8-4c4f-934d-3740a777389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:08.759284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362f57-52e8-4c4f-934d-3740a777389b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:08.759574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362f57-52e8-4c4f-934d-3740a777389b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:08.759848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362f57-52e8-4c4f-934d-3740a777389b None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:08.761060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b362f57-52e8-4c4f-934d-3740a777389b None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:08.762648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b362f57-52e8-4c4f-934d-3740a777389b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:08.764773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 116/233] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:08 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:08.771082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2825cb-d776-424e-81e9-b8af7cdcda39 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:08.945955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2825cb-d776-424e-81e9-b8af7cdcda39 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:08.988452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919a379-8722-4224-924a-1199b0f521a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:08.989361 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919a379-8722-4224-924a-1199b0f521a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:08.989635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919a379-8722-4224-924a-1199b0f521a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:08.989904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919a379-8722-4224-924a-1199b0f521a0 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd/users/468ae0b1f95941b3a170a3f384446727/roles/26c081183cd3490c977d961b36b9cee4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:08.992171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919a379-8722-4224-924a-1199b0f521a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=89fcb966a1644945aee124d621ce16dd, user_id=468ae0b1f95941b3a170a3f384446727, role_id=26c081183cd3490c977d961b36b9cee4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:08.993626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919a379-8722-4224-924a-1199b0f521a0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:09.009316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 118/234] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:07:08 2022] PUT /identity/v3/projects/89fcb966a1644945aee124d621ce16dd/users/468ae0b1f95941b3a170a3f384446727/roles/26c081183cd3490c977d961b36b9cee4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:09.429222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5597b-0970-4d16-bb4b-51751bc7c49f None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:09.429495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5597b-0970-4d16-bb4b-51751bc7c49f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:09.429766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5597b-0970-4d16-bb4b-51751bc7c49f None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:09.431530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 117/235] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:09.437431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df402f-a3bb-431b-aa06-d23a508ec70d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:09.437723 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df402f-a3bb-431b-aa06-d23a508ec70d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:09.438004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df402f-a3bb-431b-aa06-d23a508ec70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:09.459589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-42df402f-a3bb-431b-aa06-d23a508ec70d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:09.460796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-42df402f-a3bb-431b-aa06-d23a508ec70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:09.483937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1bf07-9859-411a-8e89-6696be2d95be None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:09.484249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1bf07-9859-411a-8e89-6696be2d95be None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:09.484491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1bf07-9859-411a-8e89-6696be2d95be None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:09.486266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 118/236] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:09.493240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc2e03-f721-4027-8a15-1f9fb4b8ecc6 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:09.493531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc2e03-f721-4027-8a15-1f9fb4b8ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:09.493813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc2e03-f721-4027-8a15-1f9fb4b8ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:09.510353 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:09.527833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-67dc2e03-f721-4027-8a15-1f9fb4b8ecc6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:09.529073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-67dc2e03-f721-4027-8a15-1f9fb4b8ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:09.544475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 119/237] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:09.579539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df402f-a3bb-431b-aa06-d23a508ec70d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:09.600217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:09.605154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 119/238] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:09.630831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc2e03-f721-4027-8a15-1f9fb4b8ecc6 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:09.732148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df402f-a3bb-431b-aa06-d23a508ec70d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:09.738640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc2e03-f721-4027-8a15-1f9fb4b8ecc6 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:09.777382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80618913-837a-499a-b7bb-86482e5be865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:09.777914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecbc96-52b9-4d05-885a-de0a0a7ab505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:09.778202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80618913-837a-499a-b7bb-86482e5be865 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:09.778335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecbc96-52b9-4d05-885a-de0a0a7ab505 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:09.778482 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80618913-837a-499a-b7bb-86482e5be865 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:09.778595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecbc96-52b9-4d05-885a-de0a0a7ab505 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:09.778785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80618913-837a-499a-b7bb-86482e5be865 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:09.778882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecbc96-52b9-4d05-885a-de0a0a7ab505 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:09.780238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecbc96-52b9-4d05-885a-de0a0a7ab505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:09.781710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecbc96-52b9-4d05-885a-de0a0a7ab505 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:09.784015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 120/239] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:09.789346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecbc96-52b9-4d05-885a-de0a0a7ab505 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:09.804224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80618913-837a-499a-b7bb-86482e5be865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-80618913-837a-499a-b7bb-86482e5be865 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:09.820421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:09.821382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:09.822190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:09.826209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 120/240] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:09.827391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80618913-837a-499a-b7bb-86482e5be865 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:09.861303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:09.891936 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:09.899578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecbc96-52b9-4d05-885a-de0a0a7ab505 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:09.936328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2baecb-eb7b-4bb1-91f9-177e01cf899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:09.937136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2baecb-eb7b-4bb1-91f9-177e01cf899f None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:09.937431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2baecb-eb7b-4bb1-91f9-177e01cf899f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:09.937713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2baecb-eb7b-4bb1-91f9-177e01cf899f None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:09.938435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2baecb-eb7b-4bb1-91f9-177e01cf899f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:09.939931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2baecb-eb7b-4bb1-91f9-177e01cf899f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:09.961542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 121/241] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:07:09 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:07:10.056122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80618913-837a-499a-b7bb-86482e5be865 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:10.109089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89095015-97c6-40d2-a13d-c30c4305f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:10.110185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095015-97c6-40d2-a13d-c30c4305f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:10.110695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095015-97c6-40d2-a13d-c30c4305f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:10.111164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095015-97c6-40d2-a13d-c30c4305f9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:10.112144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89095015-97c6-40d2-a13d-c30c4305f9b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:10.112671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89095015-97c6-40d2-a13d-c30c4305f9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:10.114310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89095015-97c6-40d2-a13d-c30c4305f9b6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:10.130132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 121/242] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:10.135799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2baecb-eb7b-4bb1-91f9-177e01cf899f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:10.303486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2baecb-eb7b-4bb1-91f9-177e01cf899f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:10.346891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:10.348347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea62944-0956-45cf-8bff-710db3bbca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:10.349316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62944-0956-45cf-8bff-710db3bbca59 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:10.349706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62944-0956-45cf-8bff-710db3bbca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:10.349985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62944-0956-45cf-8bff-710db3bbca59 None admin] PATH_INFO: `/v3/users/28e3fb27f63f4f32be991d71b77f28b8` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:10.368727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea62944-0956-45cf-8bff-710db3bbca59 None admin] RBAC: Authorizing `identity:get_user(user_id=28e3fb27f63f4f32be991d71b77f28b8)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:10.370307 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea62944-0956-45cf-8bff-710db3bbca59 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:10.372130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 122/243] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:10 2022] GET /identity/v3/users/28e3fb27f63f4f32be991d71b77f28b8 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:10.377970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89095015-97c6-40d2-a13d-c30c4305f9b6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:10.484447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:10.489948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89095015-97c6-40d2-a13d-c30c4305f9b6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:10.532313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3c48-aace-4eb5-b3f2-1641a57622cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:10.532992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3c48-aace-4eb5-b3f2-1641a57622cc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:10.533586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3c48-aace-4eb5-b3f2-1641a57622cc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:10.533866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3c48-aace-4eb5-b3f2-1641a57622cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:10.615137 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e3c48-aace-4eb5-b3f2-1641a57622cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:10.616674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e3c48-aace-4eb5-b3f2-1641a57622cc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:10.703812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f75866-5fa1-4917-84aa-2d98942db884 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:10.704330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f75866-5fa1-4917-84aa-2d98942db884 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:10.704752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f75866-5fa1-4917-84aa-2d98942db884 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:10.706293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 123/244] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:07:10.713117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7addf91-37aa-413a-bda4-b4b36800491e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:10.713645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7addf91-37aa-413a-bda4-b4b36800491e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:10.714066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7addf91-37aa-413a-bda4-b4b36800491e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:10.739260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b7addf91-37aa-413a-bda4-b4b36800491e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:10.741293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b7addf91-37aa-413a-bda4-b4b36800491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:10.748516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:10.756487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 122/245] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:10.763280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3c48-aace-4eb5-b3f2-1641a57622cc None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:10.854526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 124/246] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:10.855867 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d5433-f5dc-4429-9f80-3fc4acd88a81 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:10.856156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d5433-f5dc-4429-9f80-3fc4acd88a81 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:10.856432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d5433-f5dc-4429-9f80-3fc4acd88a81 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:10.862177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 125/247] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:10.866548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1e53c-6e81-40ee-bf43-a0fab6f1d5f9 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:10.866760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1e53c-6e81-40ee-bf43-a0fab6f1d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:10.867058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1e53c-6e81-40ee-bf43-a0fab6f1d5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:10.893865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c9a1e53c-6e81-40ee-bf43-a0fab6f1d5f9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:10.895087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c9a1e53c-6e81-40ee-bf43-a0fab6f1d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:10.952808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3c48-aace-4eb5-b3f2-1641a57622cc None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:11.023204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ab6c-9221-4936-9211-f2d9fb45f849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:11.024149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ab6c-9221-4936-9211-f2d9fb45f849 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:11.024427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ab6c-9221-4936-9211-f2d9fb45f849 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:11.024696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ab6c-9221-4936-9211-f2d9fb45f849 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:11.026078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ab6c-9221-4936-9211-f2d9fb45f849 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:11.027566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ab6c-9221-4936-9211-f2d9fb45f849 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:11.031467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 123/248] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:10 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:11.032273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ab6c-9221-4936-9211-f2d9fb45f849 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:11.038611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 126/249] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:11.039582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1e53c-6e81-40ee-bf43-a0fab6f1d5f9 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:11.142563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:11.206892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:11.239512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1e53c-6e81-40ee-bf43-a0fab6f1d5f9 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:11.257621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ab6c-9221-4936-9211-f2d9fb45f849 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:11.276083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a7644-e6b8-4adf-a61a-12b323809508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:11.276806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a7644-e6b8-4adf-a61a-12b323809508 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:11.277085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a7644-e6b8-4adf-a61a-12b323809508 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:11.277360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a7644-e6b8-4adf-a61a-12b323809508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:11.278456 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a7644-e6b8-4adf-a61a-12b323809508 None admin] RBAC: Adding query filter params (role.id=819710d7e2594120b7d6b2e9c3b5d102, scope.project.id=89fcb966a1644945aee124d621ce16dd, user.id=28e3fb27f63f4f32be991d71b77f28b8) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:11.278804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a7644-e6b8-4adf-a61a-12b323809508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:11.280468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a7644-e6b8-4adf-a61a-12b323809508 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:11.287552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 127/250] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:11 2022] GET /identity/v3/role_assignments?user.id=28e3fb27f63f4f32be991d71b77f28b8&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=819710d7e2594120b7d6b2e9c3b5d102 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:11.288446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a7644-e6b8-4adf-a61a-12b323809508 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:11.329997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c2f48-b2aa-4e74-817a-56b1b8ac4106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:11.330869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c2f48-b2aa-4e74-817a-56b1b8ac4106 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:11.331152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c2f48-b2aa-4e74-817a-56b1b8ac4106 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:11.331422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c2f48-b2aa-4e74-817a-56b1b8ac4106 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:11.375225 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c2f48-b2aa-4e74-817a-56b1b8ac4106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b11c2f48-b2aa-4e74-817a-56b1b8ac4106 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:11.383374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:11.384434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:11.385251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 124/251] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:11.394827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c2f48-b2aa-4e74-817a-56b1b8ac4106 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:11.405087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a7644-e6b8-4adf-a61a-12b323809508 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:11.422060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:11.444422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18665953-0304-4c05-b98d-f30e6da59310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:11.449765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18665953-0304-4c05-b98d-f30e6da59310 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:11.451437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18665953-0304-4c05-b98d-f30e6da59310 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:11.451437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18665953-0304-4c05-b98d-f30e6da59310 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:11.465883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18665953-0304-4c05-b98d-f30e6da59310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-18665953-0304-4c05-b98d-f30e6da59310 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:11.477820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:11.481012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:11.481833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 128/252] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:07:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:11.493482 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18665953-0304-4c05-b98d-f30e6da59310 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:11.683648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c2f48-b2aa-4e74-817a-56b1b8ac4106 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:11.734201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18665953-0304-4c05-b98d-f30e6da59310 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:11.744967 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:11.763613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b7120-3804-4a19-b064-e5e15d992ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:11.764662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b7120-3804-4a19-b064-e5e15d992ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:11.765169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b7120-3804-4a19-b064-e5e15d992ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:11.765646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b7120-3804-4a19-b064-e5e15d992ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:11.766632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b7120-3804-4a19-b064-e5e15d992ff1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:11.767136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b7120-3804-4a19-b064-e5e15d992ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:11.768772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b7120-3804-4a19-b064-e5e15d992ff1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:11.776845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476742d-1115-4af2-9e30-9b9e5d0b6af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:11.777548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476742d-1115-4af2-9e30-9b9e5d0b6af8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:11.777836 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476742d-1115-4af2-9e30-9b9e5d0b6af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:11.778112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476742d-1115-4af2-9e30-9b9e5d0b6af8 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:11.778986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476742d-1115-4af2-9e30-9b9e5d0b6af8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:11.779370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476742d-1115-4af2-9e30-9b9e5d0b6af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:11.781324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476742d-1115-4af2-9e30-9b9e5d0b6af8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:11.795072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 129/253] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:11.795473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 125/254] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:11.801595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476742d-1115-4af2-9e30-9b9e5d0b6af8 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:11.803387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b7120-3804-4a19-b064-e5e15d992ff1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:11.868829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:11.956279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476742d-1115-4af2-9e30-9b9e5d0b6af8 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:11.998763 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab3586-a3c4-4bd4-9cb1-cf299679a929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:11.999700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3586-a3c4-4bd4-9cb1-cf299679a929 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:11.999988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3586-a3c4-4bd4-9cb1-cf299679a929 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.000268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3586-a3c4-4bd4-9cb1-cf299679a929 None admin] PATH_INFO: `/v3/users/468ae0b1f95941b3a170a3f384446727` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.001700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab3586-a3c4-4bd4-9cb1-cf299679a929 None admin] RBAC: Authorizing `identity:get_user(user_id=468ae0b1f95941b3a170a3f384446727)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:12.003684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab3586-a3c4-4bd4-9cb1-cf299679a929 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:12.005395 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 130/255] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:11 2022] GET /identity/v3/users/468ae0b1f95941b3a170a3f384446727 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:12.006666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098f18-b37c-4dc4-a85c-7f66baf29ac3 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:12.006955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098f18-b37c-4dc4-a85c-7f66baf29ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.007236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098f18-b37c-4dc4-a85c-7f66baf29ac3 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.010187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 131/256] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:12.015716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b4279-6ed3-47d8-a986-bc3efe3299a3 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:12.019218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b4279-6ed3-47d8-a986-bc3efe3299a3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.019691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b4279-6ed3-47d8-a986-bc3efe3299a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.041459 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b7120-3804-4a19-b064-e5e15d992ff1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:12.063221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-086b4279-6ed3-47d8-a986-bc3efe3299a3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:12.065450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-086b4279-6ed3-47d8-a986-bc3efe3299a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:12.135890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b4188-2a6c-4c76-9f03-28317abb13af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:12.137424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4188-2a6c-4c76-9f03-28317abb13af None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:12.138389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4188-2a6c-4c76-9f03-28317abb13af None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.139982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4188-2a6c-4c76-9f03-28317abb13af None admin] PATH_INFO: `/v3/users/a57046a0f9c049c6b7bf02f511ba44a7` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.142226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b4188-2a6c-4c76-9f03-28317abb13af None admin] RBAC: Authorizing `identity:get_user(user_id=a57046a0f9c049c6b7bf02f511ba44a7)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:12.144034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b4188-2a6c-4c76-9f03-28317abb13af None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:12.150468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 126/257] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:11 2022] GET /identity/v3/users/a57046a0f9c049c6b7bf02f511ba44a7 => generated 297 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:12.151854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b4188-2a6c-4c76-9f03-28317abb13af None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:12.204392 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 132/258] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:12.205494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b4279-6ed3-47d8-a986-bc3efe3299a3 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:12.236482 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:12.272831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:12.319360 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b4188-2a6c-4c76-9f03-28317abb13af None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:12.342183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b4279-6ed3-47d8-a986-bc3efe3299a3 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:12.354983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc93bed-83d6-43e9-9f47-dbd2ef16f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:12.355942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93bed-83d6-43e9-9f47-dbd2ef16f99c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:12.356567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93bed-83d6-43e9-9f47-dbd2ef16f99c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.357032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93bed-83d6-43e9-9f47-dbd2ef16f99c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.380438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fb275-9dcd-43bb-9351-cca009ab0d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:12.381348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fb275-9dcd-43bb-9351-cca009ab0d46 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:12.381632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fb275-9dcd-43bb-9351-cca009ab0d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.381906 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fb275-9dcd-43bb-9351-cca009ab0d46 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.383380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fb275-9dcd-43bb-9351-cca009ab0d46 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:12.384971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fb275-9dcd-43bb-9351-cca009ab0d46 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:12.387310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 133/259] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:12 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:12.388210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fb275-9dcd-43bb-9351-cca009ab0d46 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:12.441099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc93bed-83d6-43e9-9f47-dbd2ef16f99c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:12.442997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc93bed-83d6-43e9-9f47-dbd2ef16f99c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:12.519516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:12.526853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:12.529310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fb275-9dcd-43bb-9351-cca009ab0d46 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:12.591362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35db5-21d3-47bf-9b49-9f4cbfee77a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:12.592319 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35db5-21d3-47bf-9b49-9f4cbfee77a0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:12.592613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35db5-21d3-47bf-9b49-9f4cbfee77a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.592953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35db5-21d3-47bf-9b49-9f4cbfee77a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.604913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc35db5-21d3-47bf-9b49-9f4cbfee77a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:12.610125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 127/260] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:12.611307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc93bed-83d6-43e9-9f47-dbd2ef16f99c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-6cc35db5-21d3-47bf-9b49-9f4cbfee77a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:12.618185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:12.619169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:12.619996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:12.621113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 134/261] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:12.621552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35db5-21d3-47bf-9b49-9f4cbfee77a0 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:12.738344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35db5-21d3-47bf-9b49-9f4cbfee77a0 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:12.780159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118544c-52da-4b19-977f-5157d253e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:12.781045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118544c-52da-4b19-977f-5157d253e6bd None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:12.781333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118544c-52da-4b19-977f-5157d253e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.781616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118544c-52da-4b19-977f-5157d253e6bd None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.782915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118544c-52da-4b19-977f-5157d253e6bd None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:12.784767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118544c-52da-4b19-977f-5157d253e6bd None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:12.786539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 135/262] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:12 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:12.787458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118544c-52da-4b19-977f-5157d253e6bd None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:12.821805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc93bed-83d6-43e9-9f47-dbd2ef16f99c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:12.846893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:12.892695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26a535-a2a8-41bd-96c6-7ec6e76eb743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:12.893604 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26a535-a2a8-41bd-96c6-7ec6e76eb743 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:12.893885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26a535-a2a8-41bd-96c6-7ec6e76eb743 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.894160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26a535-a2a8-41bd-96c6-7ec6e76eb743 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd/users/a57046a0f9c049c6b7bf02f511ba44a7/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.898279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118544c-52da-4b19-977f-5157d253e6bd None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:12.899862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26a535-a2a8-41bd-96c6-7ec6e76eb743 None admin] RBAC: Authorizing `identity:create_grant(project_id=89fcb966a1644945aee124d621ce16dd, user_id=a57046a0f9c049c6b7bf02f511ba44a7, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:12.901331 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26a535-a2a8-41bd-96c6-7ec6e76eb743 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:12.929019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 128/263] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:07:12 2022] PUT /identity/v3/projects/89fcb966a1644945aee124d621ce16dd/users/a57046a0f9c049c6b7bf02f511ba44a7/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:12.929659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26a535-a2a8-41bd-96c6-7ec6e76eb743 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:12.946657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886c314-c8d7-41a1-9240-6b46766de620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:12.947501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886c314-c8d7-41a1-9240-6b46766de620 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:12.947825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886c314-c8d7-41a1-9240-6b46766de620 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.948144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886c314-c8d7-41a1-9240-6b46766de620 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.949066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886c314-c8d7-41a1-9240-6b46766de620 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:12.949401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886c314-c8d7-41a1-9240-6b46766de620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:12.950948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886c314-c8d7-41a1-9240-6b46766de620 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:12.963263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:12.976601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 136/264] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:12.992002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043c39-2fd5-4da7-91f7-0bd8592fdea2 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:12.992653 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043c39-2fd5-4da7-91f7-0bd8592fdea2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:12.993223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043c39-2fd5-4da7-91f7-0bd8592fdea2 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:12.994857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 137/265] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:07:12.995862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043c39-2fd5-4da7-91f7-0bd8592fdea2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:13.062219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26a535-a2a8-41bd-96c6-7ec6e76eb743 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:13.098991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8a99b-7db8-40eb-ae38-a57d5f98c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:13.099871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8a99b-7db8-40eb-ae38-a57d5f98c579 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:13.100155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8a99b-7db8-40eb-ae38-a57d5f98c579 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:13.100482 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8a99b-7db8-40eb-ae38-a57d5f98c579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:13.101345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8a99b-7db8-40eb-ae38-a57d5f98c579 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=89fcb966a1644945aee124d621ce16dd, user.id=468ae0b1f95941b3a170a3f384446727) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:13.101659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8a99b-7db8-40eb-ae38-a57d5f98c579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:13.103410 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8a99b-7db8-40eb-ae38-a57d5f98c579 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:13.111284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 129/266] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:12 2022] GET /identity/v3/role_assignments?user.id=468ae0b1f95941b3a170a3f384446727&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:13.112652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e2173-f947-4cc4-ac6e-4b2c3dcdf2b6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:13.112941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e2173-f947-4cc4-ac6e-4b2c3dcdf2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:13.113272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e2173-f947-4cc4-ac6e-4b2c3dcdf2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:13.134370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-232e2173-f947-4cc4-ac6e-4b2c3dcdf2b6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:13.135750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-232e2173-f947-4cc4-ac6e-4b2c3dcdf2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:13.248730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 130/267] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:13.262652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:13.292955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043c39-2fd5-4da7-91f7-0bd8592fdea2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:13.303484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e2173-f947-4cc4-ac6e-4b2c3dcdf2b6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:13.324737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:13.360206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16e41f-b3cc-4f80-8ef8-1f9e25c900da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:13.361112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e41f-b3cc-4f80-8ef8-1f9e25c900da None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:13.361393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e41f-b3cc-4f80-8ef8-1f9e25c900da None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:13.361669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e41f-b3cc-4f80-8ef8-1f9e25c900da None admin] PATH_INFO: `/v3/users/468ae0b1f95941b3a170a3f384446727` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:13.368462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16e41f-b3cc-4f80-8ef8-1f9e25c900da None admin] RBAC: Authorizing `identity:get_user(user_id=468ae0b1f95941b3a170a3f384446727)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:13.369979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16e41f-b3cc-4f80-8ef8-1f9e25c900da None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:13.372081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 138/268] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:12 2022] GET /identity/v3/users/468ae0b1f95941b3a170a3f384446727 => generated 283 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:13.373436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbbf00-929d-4b9a-922f-321948f98c06 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:13.373742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbbf00-929d-4b9a-922f-321948f98c06 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:13.374013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbbf00-929d-4b9a-922f-321948f98c06 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:13.375563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 139/269] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:13.382037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbbf00-929d-4b9a-922f-321948f98c06 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:13.459745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e2173-f947-4cc4-ac6e-4b2c3dcdf2b6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:13.507827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad14c5f-ce06-4173-bd20-7aa0d12754a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:13.509042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14c5f-ce06-4173-bd20-7aa0d12754a8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:13.509649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14c5f-ce06-4173-bd20-7aa0d12754a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:13.510387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14c5f-ce06-4173-bd20-7aa0d12754a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:13.511211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbbf00-929d-4b9a-922f-321948f98c06 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:13.530905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad14c5f-ce06-4173-bd20-7aa0d12754a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-4ad14c5f-ce06-4173-bd20-7aa0d12754a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:13.542140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:13.543191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:13.544032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:13.547400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 131/270] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:13.548920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068d27-2e49-43a0-ac8b-eba7935050d6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:13.549366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068d27-2e49-43a0-ac8b-eba7935050d6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:13.549764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068d27-2e49-43a0-ac8b-eba7935050d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:13.564315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcdfa3-00b8-4278-8ac1-4b829ea3f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:13.565162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcdfa3-00b8-4278-8ac1-4b829ea3f616 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:13.565599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcdfa3-00b8-4278-8ac1-4b829ea3f616 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:13.565983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcdfa3-00b8-4278-8ac1-4b829ea3f616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:13.575075 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ca068d27-2e49-43a0-ac8b-eba7935050d6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:13.576557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ca068d27-2e49-43a0-ac8b-eba7935050d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:13.595962 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:13.656119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcdfa3-00b8-4278-8ac1-4b829ea3f616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:13.657800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcdfa3-00b8-4278-8ac1-4b829ea3f616 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:13.667314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:13.682972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 132/271] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:13.684117 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068d27-2e49-43a0-ac8b-eba7935050d6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:13.785962 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 140/272] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:13.791657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcdfa3-00b8-4278-8ac1-4b829ea3f616 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:13.812529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068d27-2e49-43a0-ac8b-eba7935050d6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:13.860076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b12a1d-7120-44e1-86bc-e3cf826588c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:13.861190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12a1d-7120-44e1-86bc-e3cf826588c1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:13.861912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12a1d-7120-44e1-86bc-e3cf826588c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:13.862392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12a1d-7120-44e1-86bc-e3cf826588c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:13.863355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b12a1d-7120-44e1-86bc-e3cf826588c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:13.863833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b12a1d-7120-44e1-86bc-e3cf826588c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:13.864893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:13.865703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b12a1d-7120-44e1-86bc-e3cf826588c1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:13.877941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 133/273] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:13.879224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b12a1d-7120-44e1-86bc-e3cf826588c1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:13.918558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcdfa3-00b8-4278-8ac1-4b829ea3f616 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:13.954788 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5f07f-6d2a-490d-a48a-4ca0dee8d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:13.955915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5f07f-6d2a-490d-a48a-4ca0dee8d432 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:13.956450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5f07f-6d2a-490d-a48a-4ca0dee8d432 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:13.956914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5f07f-6d2a-490d-a48a-4ca0dee8d432 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:13.958272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:13.958535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5f07f-6d2a-490d-a48a-4ca0dee8d432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:13.960872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5f07f-6d2a-490d-a48a-4ca0dee8d432 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:13.963087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 141/274] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:13.964917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5f07f-6d2a-490d-a48a-4ca0dee8d432 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:14.002730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b12a1d-7120-44e1-86bc-e3cf826588c1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:14.039507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ab31c-cd82-4583-a302-1bfad29d54e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:14.040388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ab31c-cd82-4583-a302-1bfad29d54e3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:14.041497 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ab31c-cd82-4583-a302-1bfad29d54e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:14.041497 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ab31c-cd82-4583-a302-1bfad29d54e3 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:14.042406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ab31c-cd82-4583-a302-1bfad29d54e3 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:14.043893 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ab31c-cd82-4583-a302-1bfad29d54e3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:14.046036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 134/275] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:13 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:14.047310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612fcb-472a-462d-9e59-5c58b51a3f08 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:14.047600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612fcb-472a-462d-9e59-5c58b51a3f08 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:14.047875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612fcb-472a-462d-9e59-5c58b51a3f08 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:14.053953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 135/276] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:14.053953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63612fcb-472a-462d-9e59-5c58b51a3f08 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:14.081676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5f07f-6d2a-490d-a48a-4ca0dee8d432 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:14.105090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:14.124712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fc2df-ee03-419f-9dfa-72d0e49c441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:14.125682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fc2df-ee03-419f-9dfa-72d0e49c441b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:14.126041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fc2df-ee03-419f-9dfa-72d0e49c441b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:14.126402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fc2df-ee03-419f-9dfa-72d0e49c441b None admin] PATH_INFO: `/v3/users/da1b3d36a43a42d2837583f4d9e6ff98` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:14.143386 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fc2df-ee03-419f-9dfa-72d0e49c441b None admin] RBAC: Authorizing `identity:get_user(user_id=da1b3d36a43a42d2837583f4d9e6ff98)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:14.145257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fc2df-ee03-419f-9dfa-72d0e49c441b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:14.153695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 142/277] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:13 2022] GET /identity/v3/users/da1b3d36a43a42d2837583f4d9e6ff98 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:14.154961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fc2df-ee03-419f-9dfa-72d0e49c441b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:14.168073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63612fcb-472a-462d-9e59-5c58b51a3f08 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:14.202419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:14.209389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94af160-25ca-4338-a127-de630d894ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:14.210279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94af160-25ca-4338-a127-de630d894ecc None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:14.210581 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94af160-25ca-4338-a127-de630d894ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:14.210885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94af160-25ca-4338-a127-de630d894ecc None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:14.211567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94af160-25ca-4338-a127-de630d894ecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:14.213017 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94af160-25ca-4338-a127-de630d894ecc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:14.235029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 136/278] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:07:14 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:07:14.248254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d68c5-f48f-4ad8-9e00-5b1b5e4934f7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:14.249340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d68c5-f48f-4ad8-9e00-5b1b5e4934f7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:14.249818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d68c5-f48f-4ad8-9e00-5b1b5e4934f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:14.276852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ff5d68c5-f48f-4ad8-9e00-5b1b5e4934f7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:14.278726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ff5d68c5-f48f-4ad8-9e00-5b1b5e4934f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:14.292043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fc2df-ee03-419f-9dfa-72d0e49c441b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:14.343898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f551aa-2f48-4cbc-8a28-4d12f831e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:14.344731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f551aa-2f48-4cbc-8a28-4d12f831e297 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:14.345151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f551aa-2f48-4cbc-8a28-4d12f831e297 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:14.345537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f551aa-2f48-4cbc-8a28-4d12f831e297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:14.347532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f551aa-2f48-4cbc-8a28-4d12f831e297 None admin] RBAC: Adding query filter params (role.id=26c081183cd3490c977d961b36b9cee4, scope.project.id=89fcb966a1644945aee124d621ce16dd, user.id=468ae0b1f95941b3a170a3f384446727) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:14.347532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f551aa-2f48-4cbc-8a28-4d12f831e297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:14.349815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f551aa-2f48-4cbc-8a28-4d12f831e297 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:14.367275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 143/279] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:14 2022] GET /identity/v3/role_assignments?user.id=468ae0b1f95941b3a170a3f384446727&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=26c081183cd3490c977d961b36b9cee4 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:14.368452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f551aa-2f48-4cbc-8a28-4d12f831e297 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:14.380709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 137/280] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:14.411859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d68c5-f48f-4ad8-9e00-5b1b5e4934f7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:14.455920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:14.529358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f551aa-2f48-4cbc-8a28-4d12f831e297 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:14.567491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d68c5-f48f-4ad8-9e00-5b1b5e4934f7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:14.575440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc09bb-a616-478d-aaaa-3cee777cfb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:14.576469 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc09bb-a616-478d-aaaa-3cee777cfb9a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:14.576927 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc09bb-a616-478d-aaaa-3cee777cfb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:14.578288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc09bb-a616-478d-aaaa-3cee777cfb9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:14.578866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc09bb-a616-478d-aaaa-3cee777cfb9a None admin] RBAC: Adding query filter params (role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, user.id=da1b3d36a43a42d2837583f4d9e6ff98, scope.system=all) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:14.579182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc09bb-a616-478d-aaaa-3cee777cfb9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:14.580684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc09bb-a616-478d-aaaa-3cee777cfb9a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:14.590586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 144/281] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Jun 22 10:07:14 2022] GET /identity/v3/role_assignments?user.id=da1b3d36a43a42d2837583f4d9e6ff98&scope.system=all&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:14.599720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:14.620468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b0da-6d72-4ab7-90f4-fab026353aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:14.621349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b0da-6d72-4ab7-90f4-fab026353aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:14.621635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b0da-6d72-4ab7-90f4-fab026353aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:14.621924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b0da-6d72-4ab7-90f4-fab026353aa5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:14.636764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484b0da-6d72-4ab7-90f4-fab026353aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-e484b0da-6d72-4ab7-90f4-fab026353aa5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:14.645412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:14.646466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:14.647323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 138/282] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:14.655191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc09bb-a616-478d-aaaa-3cee777cfb9a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:14.789869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc09bb-a616-478d-aaaa-3cee777cfb9a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:14.799986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:14.833841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74742960-9543-4011-9edf-ce28b3c2a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:14.834664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74742960-9543-4011-9edf-ce28b3c2a93a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:14.834964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74742960-9543-4011-9edf-ce28b3c2a93a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:14.835244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74742960-9543-4011-9edf-ce28b3c2a93a None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:14.836015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74742960-9543-4011-9edf-ce28b3c2a93a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:14.836327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74742960-9543-4011-9edf-ce28b3c2a93a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:14.837742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74742960-9543-4011-9edf-ce28b3c2a93a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:14.849642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 145/283] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:14.856467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b0da-6d72-4ab7-90f4-fab026353aa5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:14.979261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b0da-6d72-4ab7-90f4-fab026353aa5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:15.037744 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef41f83-0398-4469-b581-01a59fb6aeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:15.038841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef41f83-0398-4469-b581-01a59fb6aeee None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:15.039130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef41f83-0398-4469-b581-01a59fb6aeee None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:15.039469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef41f83-0398-4469-b581-01a59fb6aeee None admin] PATH_INFO: `/v3/users/28e3fb27f63f4f32be991d71b77f28b8` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:15.040784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef41f83-0398-4469-b581-01a59fb6aeee None admin] RBAC: Authorizing `identity:get_user(user_id=28e3fb27f63f4f32be991d71b77f28b8)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:15.042271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef41f83-0398-4469-b581-01a59fb6aeee None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:15.043991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 139/284] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:14 2022] GET /identity/v3/users/28e3fb27f63f4f32be991d71b77f28b8 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:15.049894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74742960-9543-4011-9edf-ce28b3c2a93a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:15.195136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74742960-9543-4011-9edf-ce28b3c2a93a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:15.246168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a14aaa-69a6-4829-b4f5-8677eb01c3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:15.247420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a14aaa-69a6-4829-b4f5-8677eb01c3df None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:15.247951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a14aaa-69a6-4829-b4f5-8677eb01c3df None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:15.248438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a14aaa-69a6-4829-b4f5-8677eb01c3df None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:15.249853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a14aaa-69a6-4829-b4f5-8677eb01c3df None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:15.251585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a14aaa-69a6-4829-b4f5-8677eb01c3df None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:15.254540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 146/285] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:15 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:15.259306 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef41f83-0398-4469-b581-01a59fb6aeee None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:15.334047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4a08-2d00-48cc-9e5a-0aa21b20ef4f None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:15.334380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4a08-2d00-48cc-9e5a-0aa21b20ef4f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:15.334632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4a08-2d00-48cc-9e5a-0aa21b20ef4f None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:15.335000 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:15.336179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 147/286] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:15.342271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2c98-0460-4234-9bd1-4153ecb254b8 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:15.342592 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2c98-0460-4234-9bd1-4153ecb254b8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:15.342919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2c98-0460-4234-9bd1-4153ecb254b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:15.379644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-002a2c98-0460-4234-9bd1-4153ecb254b8 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:15.380883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-002a2c98-0460-4234-9bd1-4153ecb254b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:15.412773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:15.418870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef41f83-0398-4469-b581-01a59fb6aeee None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:15.482546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38213eb0-64c9-4d6d-baa1-b4f29b9523f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:15.484135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38213eb0-64c9-4d6d-baa1-b4f29b9523f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:15.485246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38213eb0-64c9-4d6d-baa1-b4f29b9523f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:15.485897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38213eb0-64c9-4d6d-baa1-b4f29b9523f6 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd/users/28e3fb27f63f4f32be991d71b77f28b8/roles/819710d7e2594120b7d6b2e9c3b5d102` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:15.491030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38213eb0-64c9-4d6d-baa1-b4f29b9523f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=89fcb966a1644945aee124d621ce16dd, user_id=28e3fb27f63f4f32be991d71b77f28b8, role_id=819710d7e2594120b7d6b2e9c3b5d102)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:15.493490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 148/287] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:15.494405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38213eb0-64c9-4d6d-baa1-b4f29b9523f6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:15.521334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 140/288] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:07:15 2022] PUT /identity/v3/projects/89fcb966a1644945aee124d621ce16dd/users/28e3fb27f63f4f32be991d71b77f28b8/roles/819710d7e2594120b7d6b2e9c3b5d102 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:15.554409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a2c98-0460-4234-9bd1-4153ecb254b8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:15.706957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a2c98-0460-4234-9bd1-4153ecb254b8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:15.760199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560c899-0251-461a-8422-5e0479154a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:15.761035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560c899-0251-461a-8422-5e0479154a01 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:15.761316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560c899-0251-461a-8422-5e0479154a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:15.761593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560c899-0251-461a-8422-5e0479154a01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:15.779832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560c899-0251-461a-8422-5e0479154a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-e560c899-0251-461a-8422-5e0479154a01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:15.788227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:15.789926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:15.792270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 149/289] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:15.798557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38213eb0-64c9-4d6d-baa1-b4f29b9523f6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:15.956778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38213eb0-64c9-4d6d-baa1-b4f29b9523f6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:15.959214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:15.997693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f70f7e-7175-499e-bd97-ea4f57b17b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:15.998461 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f70f7e-7175-499e-bd97-ea4f57b17b44 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:15.998763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f70f7e-7175-499e-bd97-ea4f57b17b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:15.999036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f70f7e-7175-499e-bd97-ea4f57b17b44 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:15.999944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f70f7e-7175-499e-bd97-ea4f57b17b44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:16.000253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f70f7e-7175-499e-bd97-ea4f57b17b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:16.001646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f70f7e-7175-499e-bd97-ea4f57b17b44 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:16.013787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 141/290] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:16.019525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560c899-0251-461a-8422-5e0479154a01 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:16.076007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:16.186637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560c899-0251-461a-8422-5e0479154a01 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:16.236693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2648b7-d971-47a4-82be-bff9372391a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:16.237861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2648b7-d971-47a4-82be-bff9372391a4 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:16.238320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2648b7-d971-47a4-82be-bff9372391a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:16.238779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2648b7-d971-47a4-82be-bff9372391a4 None admin] PATH_INFO: `/v3/users/a57046a0f9c049c6b7bf02f511ba44a7` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:16.240164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2648b7-d971-47a4-82be-bff9372391a4 None admin] RBAC: Authorizing `identity:get_user(user_id=a57046a0f9c049c6b7bf02f511ba44a7)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:16.241805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2648b7-d971-47a4-82be-bff9372391a4 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:16.243680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 150/291] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:16 2022] GET /identity/v3/users/a57046a0f9c049c6b7bf02f511ba44a7 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:16.249513 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f70f7e-7175-499e-bd97-ea4f57b17b44 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:16.407848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f70f7e-7175-499e-bd97-ea4f57b17b44 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:16.442129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2038ec-ecd7-445d-a875-6507988610b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:16.442823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2038ec-ecd7-445d-a875-6507988610b3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:16.443102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2038ec-ecd7-445d-a875-6507988610b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:16.443373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2038ec-ecd7-445d-a875-6507988610b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:16.485058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:16.526995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2038ec-ecd7-445d-a875-6507988610b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:16.528457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2038ec-ecd7-445d-a875-6507988610b3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:16.666037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 142/292] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:16.671789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2648b7-d971-47a4-82be-bff9372391a4 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:16.803532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:16.810366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2648b7-d971-47a4-82be-bff9372391a4 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:16.860730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b9817-4242-4572-9680-f0f571cdee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:16.862008 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b9817-4242-4572-9680-f0f571cdee90 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:16.862538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b9817-4242-4572-9680-f0f571cdee90 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:16.863033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b9817-4242-4572-9680-f0f571cdee90 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:16.864520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b9817-4242-4572-9680-f0f571cdee90 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:16.866195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b9817-4242-4572-9680-f0f571cdee90 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:16.868223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 151/293] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:16 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:16.874321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2038ec-ecd7-445d-a875-6507988610b3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:16.952702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:16.989444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2038ec-ecd7-445d-a875-6507988610b3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:17.026638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bcc6-1b9c-43c1-b27d-0deaca8492eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:17.027697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bcc6-1b9c-43c1-b27d-0deaca8492eb None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.028242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bcc6-1b9c-43c1-b27d-0deaca8492eb None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.028714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bcc6-1b9c-43c1-b27d-0deaca8492eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.029827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bcc6-1b9c-43c1-b27d-0deaca8492eb None admin] RBAC: Adding query filter params (role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, scope.project.id=89fcb966a1644945aee124d621ce16dd, user.id=a57046a0f9c049c6b7bf02f511ba44a7) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:17.030344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bcc6-1b9c-43c1-b27d-0deaca8492eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:17.032053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bcc6-1b9c-43c1-b27d-0deaca8492eb None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:17.039944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 143/294] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:16 2022] GET /identity/v3/role_assignments?user.id=a57046a0f9c049c6b7bf02f511ba44a7&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:17.139990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b0ca9-3206-4825-a785-16d67bbf7ff2 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.140645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b0ca9-3206-4825-a785-16d67bbf7ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.141130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b0ca9-3206-4825-a785-16d67bbf7ff2 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.142891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 152/295] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:17.159951 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d4d8-3806-4077-92b5-994c2989cf3b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.160590 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d4d8-3806-4077-92b5-994c2989cf3b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.161090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d4d8-3806-4077-92b5-994c2989cf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.188273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2978d4d8-3806-4077-92b5-994c2989cf3b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:17.189850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2978d4d8-3806-4077-92b5-994c2989cf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:17.227051 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0ca6-f6ee-4884-b5b0-4869f16582bb None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.227686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0ca6-f6ee-4884-b5b0-4869f16582bb None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.228164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0ca6-f6ee-4884-b5b0-4869f16582bb None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.229832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 153/296] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:17.237193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d587a8-0552-4855-9437-76bc200291a1 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.237564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d587a8-0552-4855-9437-76bc200291a1 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.237755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d587a8-0552-4855-9437-76bc200291a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.270201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-84d587a8-0552-4855-9437-76bc200291a1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:17.271824 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-84d587a8-0552-4855-9437-76bc200291a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:17.309148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 144/297] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:17.339918 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d4d8-3806-4077-92b5-994c2989cf3b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:17.367346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 154/298] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:17.393489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9f8f-1e20-456d-b1aa-c365de4539a7 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.393791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9f8f-1e20-456d-b1aa-c365de4539a7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.394084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9f8f-1e20-456d-b1aa-c365de4539a7 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.395826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 155/299] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:17.400453 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae9f8f-1e20-456d-b1aa-c365de4539a7 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:17.420223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:17.467675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d4d8-3806-4077-92b5-994c2989cf3b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:17.502532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb5662-6b76-4a42-b2ac-cfdaf944b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:17.503227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb5662-6b76-4a42-b2ac-cfdaf944b072 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.503503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb5662-6b76-4a42-b2ac-cfdaf944b072 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.503768 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb5662-6b76-4a42-b2ac-cfdaf944b072 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.509132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:17.514597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb5662-6b76-4a42-b2ac-cfdaf944b072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:17.520183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae9f8f-1e20-456d-b1aa-c365de4539a7 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8dbb5662-6b76-4a42-b2ac-cfdaf944b072 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:17.522240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:17.523192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:17.523992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 145/300] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:17.525160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c098d-e92b-4579-9923-7570761ff565 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.525160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c098d-e92b-4579-9923-7570761ff565 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.525160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c098d-e92b-4579-9923-7570761ff565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.546942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-722c098d-e92b-4579-9923-7570761ff565 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:17.548193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-722c098d-e92b-4579-9923-7570761ff565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:17.560356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b722b6-d5e5-4124-b80a-8e0f394a0060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:17.561178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b722b6-d5e5-4124-b80a-8e0f394a0060 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.561456 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b722b6-d5e5-4124-b80a-8e0f394a0060 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.561738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b722b6-d5e5-4124-b80a-8e0f394a0060 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.562932 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b722b6-d5e5-4124-b80a-8e0f394a0060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:17.564402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b722b6-d5e5-4124-b80a-8e0f394a0060 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:17.566054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 156/301] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:17.566849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b722b6-d5e5-4124-b80a-8e0f394a0060 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:17.636366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 146/302] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:17.639995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c098d-e92b-4579-9923-7570761ff565 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:17.684931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b722b6-d5e5-4124-b80a-8e0f394a0060 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:17.700609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:17.722159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e08f3-134d-4b0e-89c4-5bb8c3d6ff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:17.723025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e08f3-134d-4b0e-89c4-5bb8c3d6ff8d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.723441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e08f3-134d-4b0e-89c4-5bb8c3d6ff8d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.723721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e08f3-134d-4b0e-89c4-5bb8c3d6ff8d None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.724642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e08f3-134d-4b0e-89c4-5bb8c3d6ff8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:17.724957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e08f3-134d-4b0e-89c4-5bb8c3d6ff8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:17.727244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e08f3-134d-4b0e-89c4-5bb8c3d6ff8d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:17.737151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 157/303] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:17.738011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e08f3-134d-4b0e-89c4-5bb8c3d6ff8d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:17.763222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c098d-e92b-4579-9923-7570761ff565 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:17.765254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:17.803336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f918-b28c-4f5b-ac44-2dfef89a6dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:17.804005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f918-b28c-4f5b-ac44-2dfef89a6dda None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.804293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f918-b28c-4f5b-ac44-2dfef89a6dda None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.804596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f918-b28c-4f5b-ac44-2dfef89a6dda None admin] PATH_INFO: `/v3/groups` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.805336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50f918-b28c-4f5b-ac44-2dfef89a6dda None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:17.806904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50f918-b28c-4f5b-ac44-2dfef89a6dda None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:17.834560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 147/304] 10.222.0.66 () {60 vars in 1134 bytes} [Wed Jun 22 10:07:17 2022] POST /identity/v3/groups => generated 229 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:07:17.834560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f918-b28c-4f5b-ac44-2dfef89a6dda None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:17.860190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e08f3-134d-4b0e-89c4-5bb8c3d6ff8d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:17.902803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6cf76-2433-46a1-9b21-f03133767f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:17.903440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6cf76-2433-46a1-9b21-f03133767f26 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:17.903771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6cf76-2433-46a1-9b21-f03133767f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:17.904105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6cf76-2433-46a1-9b21-f03133767f26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:17.917128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6cf76-2433-46a1-9b21-f03133767f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-c6f6cf76-2433-46a1-9b21-f03133767f26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:17.925180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:17.926213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:17.927157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:17.931611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 158/305] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:17.932683 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6cf76-2433-46a1-9b21-f03133767f26 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:17.997036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f918-b28c-4f5b-ac44-2dfef89a6dda None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:18.013917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:18.041617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:18.057553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2eaef-2ba0-4f00-b197-46eb6246a5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:18.058473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2eaef-2ba0-4f00-b197-46eb6246a5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:18.058817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2eaef-2ba0-4f00-b197-46eb6246a5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:18.059087 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2eaef-2ba0-4f00-b197-46eb6246a5a2 None admin] PATH_INFO: `/v3/users/da1b3d36a43a42d2837583f4d9e6ff98` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:18.062665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2eaef-2ba0-4f00-b197-46eb6246a5a2 None admin] RBAC: Authorizing `identity:get_user(user_id=da1b3d36a43a42d2837583f4d9e6ff98)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:18.062665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2eaef-2ba0-4f00-b197-46eb6246a5a2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:18.063852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 148/306] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:17 2022] GET /identity/v3/users/da1b3d36a43a42d2837583f4d9e6ff98 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:18.068441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6cf76-2433-46a1-9b21-f03133767f26 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:18.073712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2eaef-2ba0-4f00-b197-46eb6246a5a2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:18.107518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b3e1-a56a-455c-ab8c-4b81005e797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:18.108539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b3e1-a56a-455c-ab8c-4b81005e797f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:18.109017 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b3e1-a56a-455c-ab8c-4b81005e797f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:18.109525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b3e1-a56a-455c-ab8c-4b81005e797f None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:18.110630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44b3e1-a56a-455c-ab8c-4b81005e797f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:18.111103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44b3e1-a56a-455c-ab8c-4b81005e797f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:18.113083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44b3e1-a56a-455c-ab8c-4b81005e797f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:18.122916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 159/307] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:18.131078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b3e1-a56a-455c-ab8c-4b81005e797f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:18.203858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2eaef-2ba0-4f00-b197-46eb6246a5a2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:18.240570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b3e1-a56a-455c-ab8c-4b81005e797f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:18.244613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2d680-c16b-4706-9c5b-e4763b27d16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:18.245531 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2d680-c16b-4706-9c5b-e4763b27d16c None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:18.245806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2d680-c16b-4706-9c5b-e4763b27d16c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:18.246090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2d680-c16b-4706-9c5b-e4763b27d16c None admin] PATH_INFO: `/v3/system/users/da1b3d36a43a42d2837583f4d9e6ff98/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:18.247750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2d680-c16b-4706-9c5b-e4763b27d16c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=da1b3d36a43a42d2837583f4d9e6ff98, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:18.249725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2d680-c16b-4706-9c5b-e4763b27d16c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:18.262963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 149/308] 10.222.0.66 () {58 vars in 1334 bytes} [Wed Jun 22 10:07:18 2022] PUT /identity/v3/system/users/da1b3d36a43a42d2837583f4d9e6ff98/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:07:18.265254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a589fa-4a89-4361-84c8-25e84a7bdb8c None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:18.265497 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a589fa-4a89-4361-84c8-25e84a7bdb8c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:18.265779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a589fa-4a89-4361-84c8-25e84a7bdb8c None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:18.270688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 150/309] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:18.273985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6a4c9-e6a2-42f8-83f2-95f190a9a1f3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:18.274919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6a4c9-e6a2-42f8-83f2-95f190a9a1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:18.275222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6a4c9-e6a2-42f8-83f2-95f190a9a1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:18.289836 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0bd3b-26ba-4979-80d3-0e7b52fc0e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:18.291305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0bd3b-26ba-4979-80d3-0e7b52fc0e7c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:18.291870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0bd3b-26ba-4979-80d3-0e7b52fc0e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:18.292388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0bd3b-26ba-4979-80d3-0e7b52fc0e7c None admin] PATH_INFO: `/v3/users/8a3005cc550343a699556ad8f991f786` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:18.299339 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5de6a4c9-e6a2-42f8-83f2-95f190a9a1f3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:18.300650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5de6a4c9-e6a2-42f8-83f2-95f190a9a1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:18.310600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0bd3b-26ba-4979-80d3-0e7b52fc0e7c None admin] RBAC: Authorizing `identity:get_user(user_id=8a3005cc550343a699556ad8f991f786)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:18.312631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0bd3b-26ba-4979-80d3-0e7b52fc0e7c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:18.320183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 160/310] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:18 2022] GET /identity/v3/users/8a3005cc550343a699556ad8f991f786 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:18.321588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0bd3b-26ba-4979-80d3-0e7b52fc0e7c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:18.325533 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:18.350872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:18.406681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 151/311] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:18.435649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6a4c9-e6a2-42f8-83f2-95f190a9a1f3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:18.463160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0bd3b-26ba-4979-80d3-0e7b52fc0e7c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:18.506802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ad475-dde1-4be6-9235-f8ae26ed1bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:18.507480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad475-dde1-4be6-9235-f8ae26ed1bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:18.507766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad475-dde1-4be6-9235-f8ae26ed1bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:18.508043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad475-dde1-4be6-9235-f8ae26ed1bc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:18.508945 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ad475-dde1-4be6-9235-f8ae26ed1bc8 None admin] RBAC: Adding query filter params (role.id=819710d7e2594120b7d6b2e9c3b5d102, user.id=8a3005cc550343a699556ad8f991f786, scope.system=all) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:18.509259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ad475-dde1-4be6-9235-f8ae26ed1bc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:18.510745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ad475-dde1-4be6-9235-f8ae26ed1bc8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:18.517732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 161/312] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Jun 22 10:07:18 2022] GET /identity/v3/role_assignments?user.id=8a3005cc550343a699556ad8f991f786&scope.system=all&role.id=819710d7e2594120b7d6b2e9c3b5d102 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:18.563829 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6a4c9-e6a2-42f8-83f2-95f190a9a1f3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:18.605191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3f082-d707-4fc3-8c4d-0bee91212434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:18.606017 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3f082-d707-4fc3-8c4d-0bee91212434 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:18.606311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3f082-d707-4fc3-8c4d-0bee91212434 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:18.606617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3f082-d707-4fc3-8c4d-0bee91212434 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:18.623767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3f082-d707-4fc3-8c4d-0bee91212434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-46d3f082-d707-4fc3-8c4d-0bee91212434 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:18.631869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:18.632834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:18.633629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 152/313] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:18.639708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ad475-dde1-4be6-9235-f8ae26ed1bc8 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:18.714248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:18.748757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ad475-dde1-4be6-9235-f8ae26ed1bc8 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:18.784436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14162-4780-4e9a-affc-15ff1bbc36df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:18.785038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14162-4780-4e9a-affc-15ff1bbc36df None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:18.785324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14162-4780-4e9a-affc-15ff1bbc36df None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:18.785603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14162-4780-4e9a-affc-15ff1bbc36df None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:18.786363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14162-4780-4e9a-affc-15ff1bbc36df None admin] RBAC: Adding query filter params (name=reader) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:18.786702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14162-4780-4e9a-affc-15ff1bbc36df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:18.788103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14162-4780-4e9a-affc-15ff1bbc36df None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:18.798627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 162/314] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:18.804326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3f082-d707-4fc3-8c4d-0bee91212434 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:18.838427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:18.914440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3f082-d707-4fc3-8c4d-0bee91212434 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:18.958674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3b1da-43a6-465d-9813-de40cfc71aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:18.959837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3b1da-43a6-465d-9813-de40cfc71aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:18.960263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3b1da-43a6-465d-9813-de40cfc71aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:18.960676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3b1da-43a6-465d-9813-de40cfc71aa8 None admin] PATH_INFO: `/v3/users/28e3fb27f63f4f32be991d71b77f28b8` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:18.962058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3b1da-43a6-465d-9813-de40cfc71aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=28e3fb27f63f4f32be991d71b77f28b8)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:18.963724 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3b1da-43a6-465d-9813-de40cfc71aa8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:18.965857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 153/315] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:18 2022] GET /identity/v3/users/28e3fb27f63f4f32be991d71b77f28b8 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:18.971646 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14162-4780-4e9a-affc-15ff1bbc36df None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:19.085036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14162-4780-4e9a-affc-15ff1bbc36df None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:19.112377 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:19.120337 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721c638-a257-46dc-b836-68281040fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:19.120997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c638-a257-46dc-b836-68281040fc94 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:19.121278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c638-a257-46dc-b836-68281040fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:19.121551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c638-a257-46dc-b836-68281040fc94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:19.189838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721c638-a257-46dc-b836-68281040fc94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:19.191339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721c638-a257-46dc-b836-68281040fc94 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:19.292151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 163/316] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:19.297897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3b1da-43a6-465d-9813-de40cfc71aa8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:19.396143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:19.399696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3b1da-43a6-465d-9813-de40cfc71aa8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:19.434930 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79c9bb-18cc-4811-8446-dd48a83c9eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:19.436252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79c9bb-18cc-4811-8446-dd48a83c9eab None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:19.437178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79c9bb-18cc-4811-8446-dd48a83c9eab None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:19.437665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79c9bb-18cc-4811-8446-dd48a83c9eab None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:19.439133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79c9bb-18cc-4811-8446-dd48a83c9eab None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:19.440774 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79c9bb-18cc-4811-8446-dd48a83c9eab None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:19.443089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 154/317] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:19 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:19.449160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721c638-a257-46dc-b836-68281040fc94 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:19.480383 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:19.554067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721c638-a257-46dc-b836-68281040fc94 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:19.588685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b88f0-a9f7-44c7-90ca-fa954691a745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:19.589352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b88f0-a9f7-44c7-90ca-fa954691a745 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:19.589630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b88f0-a9f7-44c7-90ca-fa954691a745 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:19.589902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b88f0-a9f7-44c7-90ca-fa954691a745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:19.590785 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b88f0-a9f7-44c7-90ca-fa954691a745 None admin] RBAC: Adding query filter params (role.id=819710d7e2594120b7d6b2e9c3b5d102, scope.project.id=89fcb966a1644945aee124d621ce16dd, user.id=28e3fb27f63f4f32be991d71b77f28b8) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:19.591094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b88f0-a9f7-44c7-90ca-fa954691a745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:19.592639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b88f0-a9f7-44c7-90ca-fa954691a745 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:19.599206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 164/318] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:19 2022] GET /identity/v3/role_assignments?user.id=28e3fb27f63f4f32be991d71b77f28b8&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=819710d7e2594120b7d6b2e9c3b5d102 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:19.967982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce17edc-ed69-420b-9c49-bb31464c6c2a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:19.968273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce17edc-ed69-420b-9c49-bb31464c6c2a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:19.968790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce17edc-ed69-420b-9c49-bb31464c6c2a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:19.970308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 155/319] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:19.975752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14d52c-cd50-49de-8ade-4ea8ef57ce96 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:19.976211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14d52c-cd50-49de-8ade-4ea8ef57ce96 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:19.976286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14d52c-cd50-49de-8ade-4ea8ef57ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:19.993591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-7f14d52c-cd50-49de-8ade-4ea8ef57ce96 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:19.994803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-7f14d52c-cd50-49de-8ade-4ea8ef57ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:20.067470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 165/320] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:20.090252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce17edc-ed69-420b-9c49-bb31464c6c2a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:20.197601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce17edc-ed69-420b-9c49-bb31464c6c2a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:20.232937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe2d3-1957-4e16-ba33-3360b9bdbebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:20.233656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe2d3-1957-4e16-ba33-3360b9bdbebe None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:20.233947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe2d3-1957-4e16-ba33-3360b9bdbebe None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:20.234224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe2d3-1957-4e16-ba33-3360b9bdbebe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:20.235523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe2d3-1957-4e16-ba33-3360b9bdbebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:20.236975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe2d3-1957-4e16-ba33-3360b9bdbebe None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:20.243057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 156/321] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:20.244660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14d52c-cd50-49de-8ade-4ea8ef57ce96 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:20.269900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:20.352755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14d52c-cd50-49de-8ade-4ea8ef57ce96 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:20.387707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e9926-cb9c-4afc-86d8-67e8d7045f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:20.388422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e9926-cb9c-4afc-86d8-67e8d7045f60 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:20.388711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e9926-cb9c-4afc-86d8-67e8d7045f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:20.388989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e9926-cb9c-4afc-86d8-67e8d7045f60 None admin] PATH_INFO: `/v3/groups` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:20.389725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e9926-cb9c-4afc-86d8-67e8d7045f60 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:20.391236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e9926-cb9c-4afc-86d8-67e8d7045f60 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:20.403905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9bf54-9f47-4a37-ba84-ee99249a61c3 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:20.404341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9bf54-9f47-4a37-ba84-ee99249a61c3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:20.404624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9bf54-9f47-4a37-ba84-ee99249a61c3 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:20.406303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 157/322] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:07:20.407746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 166/323] 10.222.0.66 () {60 vars in 1134 bytes} [Wed Jun 22 10:07:20 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:07:20.412840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035692-f32a-41cf-abae-8a5c918e4be6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:20.413130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035692-f32a-41cf-abae-8a5c918e4be6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:20.413406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035692-f32a-41cf-abae-8a5c918e4be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:20.431978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6c035692-f32a-41cf-abae-8a5c918e4be6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:20.433537 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6c035692-f32a-41cf-abae-8a5c918e4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:20.469708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:20.515164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 158/324] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 22 10:07:20.539205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e9926-cb9c-4afc-86d8-67e8d7045f60 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:20.631974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:20.645599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363853e4-5aef-4034-bccc-d0cb5acbba38 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:20.645880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363853e4-5aef-4034-bccc-d0cb5acbba38 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:20.646149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363853e4-5aef-4034-bccc-d0cb5acbba38 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:20.647598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 159/325] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:20.653016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0955b-859d-4ce1-85ae-a89bd50ba651 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:20.653269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0955b-859d-4ce1-85ae-a89bd50ba651 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:20.653532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0955b-859d-4ce1-85ae-a89bd50ba651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:20.656369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e9926-cb9c-4afc-86d8-67e8d7045f60 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:20.679080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bbc0955b-859d-4ce1-85ae-a89bd50ba651 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:20.680258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bbc0955b-859d-4ce1-85ae-a89bd50ba651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:20.705907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9cdfa-9425-4f44-965b-e36d4405c377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:20.706810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9cdfa-9425-4f44-965b-e36d4405c377 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:20.707091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9cdfa-9425-4f44-965b-e36d4405c377 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:20.707363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9cdfa-9425-4f44-965b-e36d4405c377 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:20.720239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9cdfa-9425-4f44-965b-e36d4405c377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-4ca9cdfa-9425-4f44-965b-e36d4405c377 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:20.729039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:20.730002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:20.730860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 167/326] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:20.737990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9cdfa-9425-4f44-965b-e36d4405c377 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:20.765139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 160/327] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:20.788969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0955b-859d-4ce1-85ae-a89bd50ba651 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:20.877038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9cdfa-9425-4f44-965b-e36d4405c377 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:20.915414 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:20.918013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bfc2f-c72f-4309-85a2-853ff78f9cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:20.919104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bfc2f-c72f-4309-85a2-853ff78f9cfd None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:20.919527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bfc2f-c72f-4309-85a2-853ff78f9cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:20.920100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bfc2f-c72f-4309-85a2-853ff78f9cfd None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:20.921751 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bfc2f-c72f-4309-85a2-853ff78f9cfd None admin] RBAC: Adding query filter params (name=member) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:20.922282 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bfc2f-c72f-4309-85a2-853ff78f9cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:20.923615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0955b-859d-4ce1-85ae-a89bd50ba651 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:20.924687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bfc2f-c72f-4309-85a2-853ff78f9cfd None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:20.941079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 168/328] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:20.951904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bfc2f-c72f-4309-85a2-853ff78f9cfd None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:20.960361 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ddaea-d32c-4ec4-afe8-37c3b12658b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:20.961176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ddaea-d32c-4ec4-afe8-37c3b12658b4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:20.961450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ddaea-d32c-4ec4-afe8-37c3b12658b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:20.961715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ddaea-d32c-4ec4-afe8-37c3b12658b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:20.965292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:20.978153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ddaea-d32c-4ec4-afe8-37c3b12658b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a28ddaea-d32c-4ec4-afe8-37c3b12658b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:20.987443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:20.988437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:20.989260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 161/329] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:20.995739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ddaea-d32c-4ec4-afe8-37c3b12658b4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:21.098119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bfc2f-c72f-4309-85a2-853ff78f9cfd None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:21.131503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ddaea-d32c-4ec4-afe8-37c3b12658b4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:21.141253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760dfbf3-cd84-411d-9646-1b9dcc215792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:21.142140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dfbf3-cd84-411d-9646-1b9dcc215792 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:21.142413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dfbf3-cd84-411d-9646-1b9dcc215792 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:21.143233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dfbf3-cd84-411d-9646-1b9dcc215792 None admin] PATH_INFO: `/v3/users/da1b3d36a43a42d2837583f4d9e6ff98` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:21.144472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760dfbf3-cd84-411d-9646-1b9dcc215792 None admin] RBAC: Authorizing `identity:get_user(user_id=da1b3d36a43a42d2837583f4d9e6ff98)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:21.146432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760dfbf3-cd84-411d-9646-1b9dcc215792 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:21.149137 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 169/330] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:20 2022] GET /identity/v3/users/da1b3d36a43a42d2837583f4d9e6ff98 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:21.155850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760dfbf3-cd84-411d-9646-1b9dcc215792 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:21.196523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e760c-43f2-4a3a-abc0-96ca953cd576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:21.197514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e760c-43f2-4a3a-abc0-96ca953cd576 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:21.198216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e760c-43f2-4a3a-abc0-96ca953cd576 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:21.198491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e760c-43f2-4a3a-abc0-96ca953cd576 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:21.199538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e760c-43f2-4a3a-abc0-96ca953cd576 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:21.200082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e760c-43f2-4a3a-abc0-96ca953cd576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:21.201989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e760c-43f2-4a3a-abc0-96ca953cd576 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:21.215439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 162/331] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:21.218984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e760c-43f2-4a3a-abc0-96ca953cd576 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:21.242728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:21.267584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:21.309880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760dfbf3-cd84-411d-9646-1b9dcc215792 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:21.350485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e760c-43f2-4a3a-abc0-96ca953cd576 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:21.353106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d895-6bf5-4c34-a404-9ac6c7141c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:21.353772 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d895-6bf5-4c34-a404-9ac6c7141c14 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:21.354053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d895-6bf5-4c34-a404-9ac6c7141c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:21.354326 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d895-6bf5-4c34-a404-9ac6c7141c14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:21.355401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d895-6bf5-4c34-a404-9ac6c7141c14 None admin] RBAC: Adding query filter params (role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, user.id=da1b3d36a43a42d2837583f4d9e6ff98, scope.system=all) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:21.355723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d895-6bf5-4c34-a404-9ac6c7141c14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:21.357279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d895-6bf5-4c34-a404-9ac6c7141c14 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:21.371533 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 170/332] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Jun 22 10:07:21 2022] GET /identity/v3/role_assignments?user.id=da1b3d36a43a42d2837583f4d9e6ff98&scope.system=all&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:21.387965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36317c78-982f-487a-87af-d6fdd3b45001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:21.388981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36317c78-982f-487a-87af-d6fdd3b45001 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:21.389264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36317c78-982f-487a-87af-d6fdd3b45001 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:21.389540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36317c78-982f-487a-87af-d6fdd3b45001 None admin] PATH_INFO: `/v3/users/8a3005cc550343a699556ad8f991f786` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:21.390850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36317c78-982f-487a-87af-d6fdd3b45001 None admin] RBAC: Authorizing `identity:get_user(user_id=8a3005cc550343a699556ad8f991f786)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:21.392352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36317c78-982f-487a-87af-d6fdd3b45001 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:21.394468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 163/333] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:21 2022] GET /identity/v3/users/8a3005cc550343a699556ad8f991f786 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:21.400117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d895-6bf5-4c34-a404-9ac6c7141c14 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:21.512000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d895-6bf5-4c34-a404-9ac6c7141c14 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:21.543813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:21.554476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134de1b-8abb-4f53-9516-38e83e6aa459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:21.555403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134de1b-8abb-4f53-9516-38e83e6aa459 None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:21.555680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134de1b-8abb-4f53-9516-38e83e6aa459 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:21.555955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134de1b-8abb-4f53-9516-38e83e6aa459 None admin] PATH_INFO: `/v3/system/users/8a3005cc550343a699556ad8f991f786/roles/819710d7e2594120b7d6b2e9c3b5d102` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:21.557453 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134de1b-8abb-4f53-9516-38e83e6aa459 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8a3005cc550343a699556ad8f991f786, role_id=819710d7e2594120b7d6b2e9c3b5d102)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:21.558881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134de1b-8abb-4f53-9516-38e83e6aa459 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:21.576250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 171/334] 10.222.0.66 () {58 vars in 1334 bytes} [Wed Jun 22 10:07:21 2022] PUT /identity/v3/system/users/8a3005cc550343a699556ad8f991f786/roles/819710d7e2594120b7d6b2e9c3b5d102 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:23.301564 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe6c50-0a0b-4af7-9445-fbaf91ff1ac6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:23.302626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe6c50-0a0b-4af7-9445-fbaf91ff1ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:23.303145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe6c50-0a0b-4af7-9445-fbaf91ff1ac6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:23.305067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 164/335] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:23.320567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68341-f424-4649-b71d-f98dc86f5366 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:23.321507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68341-f424-4649-b71d-f98dc86f5366 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:23.322044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68341-f424-4649-b71d-f98dc86f5366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:23.343393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-34a68341-f424-4649-b71d-f98dc86f5366 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:23.345007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-34a68341-f424-4649-b71d-f98dc86f5366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:23.435870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 172/336] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:23.482526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe6c50-0a0b-4af7-9445-fbaf91ff1ac6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:23.561367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b257-34c5-4fef-9053-9cdd7baec300 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:23.561978 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b257-34c5-4fef-9053-9cdd7baec300 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:23.562610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b257-34c5-4fef-9053-9cdd7baec300 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:23.564321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 173/337] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:23.569820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddad67f-d472-4b66-96aa-76d2ef8ffce7 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:23.570406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddad67f-d472-4b66-96aa-76d2ef8ffce7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:23.570901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddad67f-d472-4b66-96aa-76d2ef8ffce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:23.598763 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-3ddad67f-d472-4b66-96aa-76d2ef8ffce7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:23.601447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3ddad67f-d472-4b66-96aa-76d2ef8ffce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:23.626451 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:23.655036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe6c50-0a0b-4af7-9445-fbaf91ff1ac6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:23.693955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99458970-931f-495d-a8a9-a3c8c61a4cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:23.695150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99458970-931f-495d-a8a9-a3c8c61a4cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:23.695684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99458970-931f-495d-a8a9-a3c8c61a4cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:23.696256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99458970-931f-495d-a8a9-a3c8c61a4cd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:23.709583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99458970-931f-495d-a8a9-a3c8c61a4cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-99458970-931f-495d-a8a9-a3c8c61a4cd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:23.718181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:23.719143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:23.719977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:23.722917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 165/338] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:23.724498 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c8a1-47ba-4108-b711-cd1e2bd6caba None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:23.725010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c8a1-47ba-4108-b711-cd1e2bd6caba None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:23.725483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c8a1-47ba-4108-b711-cd1e2bd6caba None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:23.727141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 166/339] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:23.728055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72c8a1-47ba-4108-b711-cd1e2bd6caba None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:23.785545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 174/340] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:23.787089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550153c-f507-4ac3-9a36-86cfeba22d51 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:23.787376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550153c-f507-4ac3-9a36-86cfeba22d51 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:23.787652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550153c-f507-4ac3-9a36-86cfeba22d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:23.820707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d550153c-f507-4ac3-9a36-86cfeba22d51 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:23.821825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d550153c-f507-4ac3-9a36-86cfeba22d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:23.844280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72c8a1-47ba-4108-b711-cd1e2bd6caba None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:23.892009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42741ca2-9a84-4255-916f-d2f20e15ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:23.893108 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42741ca2-9a84-4255-916f-d2f20e15ac22 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:23.893588 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42741ca2-9a84-4255-916f-d2f20e15ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:23.894105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42741ca2-9a84-4255-916f-d2f20e15ac22 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:23.895177 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42741ca2-9a84-4255-916f-d2f20e15ac22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:23.895684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42741ca2-9a84-4255-916f-d2f20e15ac22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:23.899157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42741ca2-9a84-4255-916f-d2f20e15ac22 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:23.915260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 167/341] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:23.919042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42741ca2-9a84-4255-916f-d2f20e15ac22 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:23.923403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:23.946823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:23.961793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 175/342] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:23.962930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550153c-f507-4ac3-9a36-86cfeba22d51 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:24.124655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42741ca2-9a84-4255-916f-d2f20e15ac22 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:24.145139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550153c-f507-4ac3-9a36-86cfeba22d51 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:24.161867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160360a-35d8-44b5-9833-cc1ce5163dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:24.162896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160360a-35d8-44b5-9833-cc1ce5163dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:24.163190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160360a-35d8-44b5-9833-cc1ce5163dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:24.167862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160360a-35d8-44b5-9833-cc1ce5163dc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:24.177589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160360a-35d8-44b5-9833-cc1ce5163dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7160360a-35d8-44b5-9833-cc1ce5163dc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:24.185909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:24.186849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:24.187675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 168/343] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:24.188340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160360a-35d8-44b5-9833-cc1ce5163dc8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:24.207244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26d546-e757-4280-8cc2-d271c5789008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:24.207928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26d546-e757-4280-8cc2-d271c5789008 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:24.208215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26d546-e757-4280-8cc2-d271c5789008 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:24.208492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26d546-e757-4280-8cc2-d271c5789008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:24.262815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:24.290979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:24.301523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160360a-35d8-44b5-9833-cc1ce5163dc8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:24.319033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26d546-e757-4280-8cc2-d271c5789008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:24.320533 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26d546-e757-4280-8cc2-d271c5789008 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:24.340076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6a586-d60a-46f0-8232-8131ec106282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:24.340909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6a586-d60a-46f0-8232-8131ec106282 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:24.341194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6a586-d60a-46f0-8232-8131ec106282 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:24.341511 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6a586-d60a-46f0-8232-8131ec106282 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:24.352749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6a586-d60a-46f0-8232-8131ec106282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-e4c6a586-d60a-46f0-8232-8131ec106282 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:24.361408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:24.362349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:24.363211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:24.363843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 169/344] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:24.364388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6a586-d60a-46f0-8232-8131ec106282 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:24.475823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6a586-d60a-46f0-8232-8131ec106282 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:24.482045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 176/345] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:24.484311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26d546-e757-4280-8cc2-d271c5789008 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:24.515706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:24.525499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e0872-71b8-4d20-9546-36e10b0d6ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:24.526729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e0872-71b8-4d20-9546-36e10b0d6ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:24.527223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e0872-71b8-4d20-9546-36e10b0d6ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:24.527762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e0872-71b8-4d20-9546-36e10b0d6ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:24.528728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e0872-71b8-4d20-9546-36e10b0d6ba2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:24.529307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e0872-71b8-4d20-9546-36e10b0d6ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:24.531129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e0872-71b8-4d20-9546-36e10b0d6ba2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:24.541478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 170/346] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:24.543391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a06fd-4981-46a4-89b4-4b78a1b0989a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:24.543878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a06fd-4981-46a4-89b4-4b78a1b0989a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:24.544402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a06fd-4981-46a4-89b4-4b78a1b0989a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:24.546689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 171/347] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:24.548091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a06fd-4981-46a4-89b4-4b78a1b0989a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:24.590719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:24.608237 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26d546-e757-4280-8cc2-d271c5789008 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:24.648975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b437b-eee9-48d7-bb9c-6fa4209073c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:24.651432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b437b-eee9-48d7-bb9c-6fa4209073c7 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:24.651432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b437b-eee9-48d7-bb9c-6fa4209073c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:24.651432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b437b-eee9-48d7-bb9c-6fa4209073c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:24.651432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b437b-eee9-48d7-bb9c-6fa4209073c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:24.651432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b437b-eee9-48d7-bb9c-6fa4209073c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:24.653410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b437b-eee9-48d7-bb9c-6fa4209073c7 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:24.663716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 177/348] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:24.664906 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b437b-eee9-48d7-bb9c-6fa4209073c7 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:24.674268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a06fd-4981-46a4-89b4-4b78a1b0989a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:24.711668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82396b01-a3ec-4174-abc0-aa6fbeeda57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:24.712919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396b01-a3ec-4174-abc0-aa6fbeeda57c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:24.713420 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396b01-a3ec-4174-abc0-aa6fbeeda57c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:24.713951 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396b01-a3ec-4174-abc0-aa6fbeeda57c None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:24.715434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82396b01-a3ec-4174-abc0-aa6fbeeda57c None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:24.717253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82396b01-a3ec-4174-abc0-aa6fbeeda57c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:24.719647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 172/349] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:24 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:24.721025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d5833-38e8-45ba-8614-63cb01b5f7ea None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:24.721520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d5833-38e8-45ba-8614-63cb01b5f7ea None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:24.726468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d5833-38e8-45ba-8614-63cb01b5f7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:24.745694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d20d5833-38e8-45ba-8614-63cb01b5f7ea None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:24.747327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d20d5833-38e8-45ba-8614-63cb01b5f7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:24.780733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b437b-eee9-48d7-bb9c-6fa4209073c7 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:24.822807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8887f-afcb-43be-a6d7-a9cbb9e17b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:24.823486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8887f-afcb-43be-a6d7-a9cbb9e17b54 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:24.823800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8887f-afcb-43be-a6d7-a9cbb9e17b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:24.824156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8887f-afcb-43be-a6d7-a9cbb9e17b54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:24.830613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:24.843891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:24.852940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 173/350] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:24.853808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d5833-38e8-45ba-8614-63cb01b5f7ea None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:24.911330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8887f-afcb-43be-a6d7-a9cbb9e17b54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:24.913212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8887f-afcb-43be-a6d7-a9cbb9e17b54 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:24.979282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d5833-38e8-45ba-8614-63cb01b5f7ea None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:25.023686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349dd2a-864e-4268-9f5f-aaf8df0b8625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:25.024355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349dd2a-864e-4268-9f5f-aaf8df0b8625 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.024633 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349dd2a-864e-4268-9f5f-aaf8df0b8625 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.025018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349dd2a-864e-4268-9f5f-aaf8df0b8625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.036243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 178/351] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:25.037177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8887f-afcb-43be-a6d7-a9cbb9e17b54 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:25.092257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:25.101694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:25.118427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349dd2a-864e-4268-9f5f-aaf8df0b8625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:25.119942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349dd2a-864e-4268-9f5f-aaf8df0b8625 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:25.158936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8887f-afcb-43be-a6d7-a9cbb9e17b54 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:25.203420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af93c16-9f30-4914-843f-9b69dd188940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:25.204299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af93c16-9f30-4914-843f-9b69dd188940 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.204576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af93c16-9f30-4914-843f-9b69dd188940 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.204847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af93c16-9f30-4914-843f-9b69dd188940 None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.211309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af93c16-9f30-4914-843f-9b69dd188940 None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:25.213161 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af93c16-9f30-4914-843f-9b69dd188940 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:25.214746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 179/352] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:25 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:25.216578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af93c16-9f30-4914-843f-9b69dd188940 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:25.248700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 174/353] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:25.249795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0e3b-82ff-4594-95c5-d7d91a1fb695 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.250081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0e3b-82ff-4594-95c5-d7d91a1fb695 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.250359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0e3b-82ff-4594-95c5-d7d91a1fb695 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.251692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 175/354] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:25.252376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac0e3b-82ff-4594-95c5-d7d91a1fb695 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:25.349128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af93c16-9f30-4914-843f-9b69dd188940 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:25.359798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:25.362692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:25.380844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac0e3b-82ff-4594-95c5-d7d91a1fb695 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:25.390733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d8790-0987-4ae3-9ce9-5908774e8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:25.391663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8790-0987-4ae3-9ce9-5908774e8920 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.391863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8790-0987-4ae3-9ce9-5908774e8920 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.392108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8790-0987-4ae3-9ce9-5908774e8920 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.410480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d8790-0987-4ae3-9ce9-5908774e8920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-1e4d8790-0987-4ae3-9ce9-5908774e8920 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:25.419265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:25.420265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 180/355] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:25.423818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b79fb3-8df0-40b5-ad83-d74bf1bb0980 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.427506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b79fb3-8df0-40b5-ad83-d74bf1bb0980 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.427506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b79fb3-8df0-40b5-ad83-d74bf1bb0980 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.427506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 181/356] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:25.427506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b79fb3-8df0-40b5-ad83-d74bf1bb0980 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:25.434542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcfa1b-cd2d-422d-800b-54ce541366e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:25.435643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcfa1b-cd2d-422d-800b-54ce541366e7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.436010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcfa1b-cd2d-422d-800b-54ce541366e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.436343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcfa1b-cd2d-422d-800b-54ce541366e7 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.437610 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcfa1b-cd2d-422d-800b-54ce541366e7 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:25.439228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcfa1b-cd2d-422d-800b-54ce541366e7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:25.440945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 176/357] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:25 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:25.441699 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcfa1b-cd2d-422d-800b-54ce541366e7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:25.556878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b79fb3-8df0-40b5-ad83-d74bf1bb0980 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:25.568868 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcfa1b-cd2d-422d-800b-54ce541366e7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:25.603751 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16904aaf-4738-4ec7-a33b-98846a5cae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:25.604561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904aaf-4738-4ec7-a33b-98846a5cae3c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.604967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904aaf-4738-4ec7-a33b-98846a5cae3c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.605250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904aaf-4738-4ec7-a33b-98846a5cae3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.606214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16904aaf-4738-4ec7-a33b-98846a5cae3c None admin] RBAC: Adding query filter params (group.id=30c4a95995f64e39acec036fd8aa814c, role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:25.606487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16904aaf-4738-4ec7-a33b-98846a5cae3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:25.608145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16904aaf-4738-4ec7-a33b-98846a5cae3c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:25.616045 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3a5bf-aee5-4394-ad55-ebb3259441e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:25.616986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3a5bf-aee5-4394-ad55-ebb3259441e9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.617275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3a5bf-aee5-4394-ad55-ebb3259441e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.617552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3a5bf-aee5-4394-ad55-ebb3259441e9 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.621883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 182/358] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 10:07:25 2022] GET /identity/v3/role_assignments?group.id=30c4a95995f64e39acec036fd8aa814c&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:25.621883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3e410-57c3-478a-965a-07145e04b486 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.621883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3e410-57c3-478a-965a-07145e04b486 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.621883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3e410-57c3-478a-965a-07145e04b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.623501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3a5bf-aee5-4394-ad55-ebb3259441e9 None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:25.625287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3a5bf-aee5-4394-ad55-ebb3259441e9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:25.627813 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 177/359] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:25 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:25.628927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3a5bf-aee5-4394-ad55-ebb3259441e9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:25.649329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-5ed3e410-57c3-478a-965a-07145e04b486 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:25.651653 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5ed3e410-57c3-478a-965a-07145e04b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:25.665938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:25.694164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:25.756568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 183/360] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:25.757938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d955f2-abd8-43ad-bf23-c9c7886d80f8 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.758223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d955f2-abd8-43ad-bf23-c9c7886d80f8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.758545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d955f2-abd8-43ad-bf23-c9c7886d80f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.772830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3a5bf-aee5-4394-ad55-ebb3259441e9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:25.779158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a1d955f2-abd8-43ad-bf23-c9c7886d80f8 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:25.780378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a1d955f2-abd8-43ad-bf23-c9c7886d80f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:25.825698 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9851ad7-1dc5-45b3-955f-5348315afecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:25.826359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9851ad7-1dc5-45b3-955f-5348315afecf None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:25.826739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9851ad7-1dc5-45b3-955f-5348315afecf None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:25.827021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9851ad7-1dc5-45b3-955f-5348315afecf None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:25.827760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9851ad7-1dc5-45b3-955f-5348315afecf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:25.828101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9851ad7-1dc5-45b3-955f-5348315afecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:25.829512 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9851ad7-1dc5-45b3-955f-5348315afecf None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:25.839165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 178/361] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:25.840028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9851ad7-1dc5-45b3-955f-5348315afecf None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:25.877952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 184/362] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:25.878971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d955f2-abd8-43ad-bf23-c9c7886d80f8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:25.959199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:25.980589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9851ad7-1dc5-45b3-955f-5348315afecf None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:25.996241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:26.005716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d955f2-abd8-43ad-bf23-c9c7886d80f8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:26.028410 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cc5d2-40fc-489e-8e15-bc6803c08032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:26.030114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cc5d2-40fc-489e-8e15-bc6803c08032 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:26.030883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cc5d2-40fc-489e-8e15-bc6803c08032 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:26.031253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cc5d2-40fc-489e-8e15-bc6803c08032 None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:26.032622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cc5d2-40fc-489e-8e15-bc6803c08032 None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:26.034578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cc5d2-40fc-489e-8e15-bc6803c08032 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:26.036523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 179/363] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:25 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:26.037637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cc5d2-40fc-489e-8e15-bc6803c08032 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:26.053389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a99452-3416-4b74-9ed1-6656fb77593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:26.054698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99452-3416-4b74-9ed1-6656fb77593b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:26.055074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99452-3416-4b74-9ed1-6656fb77593b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:26.055405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99452-3416-4b74-9ed1-6656fb77593b None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:26.056608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a99452-3416-4b74-9ed1-6656fb77593b None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:26.058099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a99452-3416-4b74-9ed1-6656fb77593b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:26.060013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 185/364] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:25 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:26.061173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a99452-3416-4b74-9ed1-6656fb77593b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:26.192248 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cc5d2-40fc-489e-8e15-bc6803c08032 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:26.220631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a99452-3416-4b74-9ed1-6656fb77593b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:26.243908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a5c21-3392-44a4-bf34-0b4c3d53e572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:26.245257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a5c21-3392-44a4-bf34-0b4c3d53e572 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:26.245704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a5c21-3392-44a4-bf34-0b4c3d53e572 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:26.246160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a5c21-3392-44a4-bf34-0b4c3d53e572 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:26.261338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a5c21-3392-44a4-bf34-0b4c3d53e572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:26.267064 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b5800-207f-45c0-b0e5-b7612971f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:26.267958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b5800-207f-45c0-b0e5-b7612971f60b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:26.268234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b5800-207f-45c0-b0e5-b7612971f60b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:26.268658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b5800-207f-45c0-b0e5-b7612971f60b None admin] PATH_INFO: `/v3/users/8a3005cc550343a699556ad8f991f786` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:26.270791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b5800-207f-45c0-b0e5-b7612971f60b None admin] RBAC: Authorizing `identity:get_user(user_id=8a3005cc550343a699556ad8f991f786)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-df1a5c21-3392-44a4-bf34-0b4c3d53e572 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:26.271257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:26.272208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:26.273048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:26.273728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b5800-207f-45c0-b0e5-b7612971f60b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:26.273798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 180/365] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:26.273798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a5c21-3392-44a4-bf34-0b4c3d53e572 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:26.274478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 186/366] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:07:26 2022] GET /identity/v3/users/8a3005cc550343a699556ad8f991f786 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:26.279494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b5800-207f-45c0-b0e5-b7612971f60b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:26.299272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:26.315430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:26.396815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b5800-207f-45c0-b0e5-b7612971f60b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:26.397576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a5c21-3392-44a4-bf34-0b4c3d53e572 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:26.434717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7434b-248b-43a3-8cc8-1f29b88453e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:26.435626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7434b-248b-43a3-8cc8-1f29b88453e5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:26.435873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7434b-248b-43a3-8cc8-1f29b88453e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:26.436150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7434b-248b-43a3-8cc8-1f29b88453e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:26.438081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2aeee-08cb-481b-8b2c-0990159be122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:26.439179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2aeee-08cb-481b-8b2c-0990159be122 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:26.439465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2aeee-08cb-481b-8b2c-0990159be122 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:26.442481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2aeee-08cb-481b-8b2c-0990159be122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:26.442481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2aeee-08cb-481b-8b2c-0990159be122 None admin] RBAC: Adding query filter params (group.id=30c4a95995f64e39acec036fd8aa814c, role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, scope.project.id=89fcb966a1644945aee124d621ce16dd) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:26.442481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2aeee-08cb-481b-8b2c-0990159be122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:26.442756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2aeee-08cb-481b-8b2c-0990159be122 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:26.449972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 187/367] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 10:07:26 2022] GET /identity/v3/role_assignments?group.id=30c4a95995f64e39acec036fd8aa814c&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:26.450924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2aeee-08cb-481b-8b2c-0990159be122 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:26.454228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7434b-248b-43a3-8cc8-1f29b88453e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5ce7434b-248b-43a3-8cc8-1f29b88453e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:26.462396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:26.463515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:26.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:26.479792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 181/368] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:07:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:26.481174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7434b-248b-43a3-8cc8-1f29b88453e5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:26.582546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:26.585845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:26.591525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2aeee-08cb-481b-8b2c-0990159be122 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:26.622535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7434b-248b-43a3-8cc8-1f29b88453e5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:26.646922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b422c-016f-4e72-82e2-4f5a9fd910a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:26.647748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b422c-016f-4e72-82e2-4f5a9fd910a9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:26.648102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b422c-016f-4e72-82e2-4f5a9fd910a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:26.648486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b422c-016f-4e72-82e2-4f5a9fd910a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:26.650767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b422c-016f-4e72-82e2-4f5a9fd910a9 None admin] RBAC: Adding query filter params (group.id=30c4a95995f64e39acec036fd8aa814c, role.id=26c081183cd3490c977d961b36b9cee4, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:26.650767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b422c-016f-4e72-82e2-4f5a9fd910a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:26.652388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b422c-016f-4e72-82e2-4f5a9fd910a9 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:26.661788 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 188/369] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 10:07:26 2022] GET /identity/v3/role_assignments?group.id=30c4a95995f64e39acec036fd8aa814c&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=26c081183cd3490c977d961b36b9cee4 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:26.664603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b422c-016f-4e72-82e2-4f5a9fd910a9 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:26.680616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b592-6449-49dd-9c02-11df8be9ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:26.681717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b592-6449-49dd-9c02-11df8be9ebb1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:26.682190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b592-6449-49dd-9c02-11df8be9ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:26.682692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b592-6449-49dd-9c02-11df8be9ebb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:26.683688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b592-6449-49dd-9c02-11df8be9ebb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:26.684222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b592-6449-49dd-9c02-11df8be9ebb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:26.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b592-6449-49dd-9c02-11df8be9ebb1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:26.699243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 182/370] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:26.700474 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b592-6449-49dd-9c02-11df8be9ebb1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:26.814106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b422c-016f-4e72-82e2-4f5a9fd910a9 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:26.866333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f5d82-4be6-4184-ad41-a99ebd549a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:26.867061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f5d82-4be6-4184-ad41-a99ebd549a8d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:26.867409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f5d82-4be6-4184-ad41-a99ebd549a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:26.867687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f5d82-4be6-4184-ad41-a99ebd549a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:26.868762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f5d82-4be6-4184-ad41-a99ebd549a8d None admin] RBAC: Adding query filter params (role.id=819710d7e2594120b7d6b2e9c3b5d102, user.id=8a3005cc550343a699556ad8f991f786, scope.system=all) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:26.869101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f5d82-4be6-4184-ad41-a99ebd549a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:26.870715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f5d82-4be6-4184-ad41-a99ebd549a8d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:26.886680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 189/371] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Jun 22 10:07:26 2022] GET /identity/v3/role_assignments?user.id=8a3005cc550343a699556ad8f991f786&scope.system=all&role.id=819710d7e2594120b7d6b2e9c3b5d102 => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:26.887627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f5d82-4be6-4184-ad41-a99ebd549a8d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:26.926905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:26.929237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b592-6449-49dd-9c02-11df8be9ebb1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:26.997597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b1ceb-0065-4c01-8bd0-b71c7d18b4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:26.998277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b1ceb-0065-4c01-8bd0-b71c7d18b4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:26.998583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b1ceb-0065-4c01-8bd0-b71c7d18b4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:26.998856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b1ceb-0065-4c01-8bd0-b71c7d18b4d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:26.999648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b1ceb-0065-4c01-8bd0-b71c7d18b4d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:26.999951 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b1ceb-0065-4c01-8bd0-b71c7d18b4d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:27.001366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b1ceb-0065-4c01-8bd0-b71c7d18b4d5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:27.012015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:27.033669 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 183/372] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:27.040091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b1ceb-0065-4c01-8bd0-b71c7d18b4d5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:27.107335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f5d82-4be6-4184-ad41-a99ebd549a8d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:27.178049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208b82b-a66d-4d49-9470-bce70b3cfc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:27.178798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208b82b-a66d-4d49-9470-bce70b3cfc9b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:27.179243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208b82b-a66d-4d49-9470-bce70b3cfc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:27.179527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208b82b-a66d-4d49-9470-bce70b3cfc9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:27.297144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208b82b-a66d-4d49-9470-bce70b3cfc9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:27.298652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208b82b-a66d-4d49-9470-bce70b3cfc9b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:27.318540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b1ceb-0065-4c01-8bd0-b71c7d18b4d5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:27.320629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:27.395439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d1a0-8ad6-4d4a-9088-6e1894b0f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:27.396545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d1a0-8ad6-4d4a-9088-6e1894b0f791 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:27.399317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d1a0-8ad6-4d4a-9088-6e1894b0f791 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:27.400257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d1a0-8ad6-4d4a-9088-6e1894b0f791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:27.476099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 190/373] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:27.482592 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208b82b-a66d-4d49-9470-bce70b3cfc9b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:27.537049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:27.544292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380d1a0-8ad6-4d4a-9088-6e1894b0f791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:27.546955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380d1a0-8ad6-4d4a-9088-6e1894b0f791 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:27.705518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208b82b-a66d-4d49-9470-bce70b3cfc9b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:27.746256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:27.776446 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 184/374] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:07:27.778433 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d1a0-8ad6-4d4a-9088-6e1894b0f791 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:27.791249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bab5b-0bfb-4ea5-9e47-e2f1204c7e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:27.792144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bab5b-0bfb-4ea5-9e47-e2f1204c7e53 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:27.792426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bab5b-0bfb-4ea5-9e47-e2f1204c7e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:27.792703 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bab5b-0bfb-4ea5-9e47-e2f1204c7e53 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:27.795522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bab5b-0bfb-4ea5-9e47-e2f1204c7e53 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:27.797052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bab5b-0bfb-4ea5-9e47-e2f1204c7e53 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:27.799185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 191/375] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:27 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:27.804387 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bab5b-0bfb-4ea5-9e47-e2f1204c7e53 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:27.904189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d1a0-8ad6-4d4a-9088-6e1894b0f791 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:27.923845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:27.946299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e182c-46e3-4a00-a5c6-e6507f1d4e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:27.947218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e182c-46e3-4a00-a5c6-e6507f1d4e2b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:27.947500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e182c-46e3-4a00-a5c6-e6507f1d4e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:27.947771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e182c-46e3-4a00-a5c6-e6507f1d4e2b None admin] PATH_INFO: `/v3/projects/5250969aacd849649f4438fde7d1550d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:27.949116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e182c-46e3-4a00-a5c6-e6507f1d4e2b None admin] RBAC: Authorizing `identity:get_project(project_id=5250969aacd849649f4438fde7d1550d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:27.950795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e182c-46e3-4a00-a5c6-e6507f1d4e2b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:27.952941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 185/376] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:27 2022] GET /identity/v3/projects/5250969aacd849649f4438fde7d1550d => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:27.959485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e182c-46e3-4a00-a5c6-e6507f1d4e2b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:27.978758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bab5b-0bfb-4ea5-9e47-e2f1204c7e53 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:28.017131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a130b-4f70-4da8-9cac-633ad9defe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:28.018114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a130b-4f70-4da8-9cac-633ad9defe39 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:28.018397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a130b-4f70-4da8-9cac-633ad9defe39 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:28.018700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a130b-4f70-4da8-9cac-633ad9defe39 None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:28.019900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a130b-4f70-4da8-9cac-633ad9defe39 None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:28.021373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a130b-4f70-4da8-9cac-633ad9defe39 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:28.023560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 192/377] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:27 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:28.031620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a130b-4f70-4da8-9cac-633ad9defe39 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:28.096504 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:28.116716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e182c-46e3-4a00-a5c6-e6507f1d4e2b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:28.150196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a130b-4f70-4da8-9cac-633ad9defe39 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:28.188584 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5edf42-7abd-4796-9bb6-ba95ecbb8046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:28.189372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5edf42-7abd-4796-9bb6-ba95ecbb8046 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:28.189654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5edf42-7abd-4796-9bb6-ba95ecbb8046 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:28.189928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5edf42-7abd-4796-9bb6-ba95ecbb8046 None admin] PATH_INFO: `/v3/groups/43f1e96af8c24c6e9d473f63e5bccd86` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:28.192927 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591fddf-37ae-4917-b72b-141dd28d40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:28.193662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591fddf-37ae-4917-b72b-141dd28d40e6 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:28.194390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591fddf-37ae-4917-b72b-141dd28d40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:28.194707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591fddf-37ae-4917-b72b-141dd28d40e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:28.195930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591fddf-37ae-4917-b72b-141dd28d40e6 None admin] RBAC: Adding query filter params (group.id=30c4a95995f64e39acec036fd8aa814c, role.id=26c081183cd3490c977d961b36b9cee4, scope.project.id=89fcb966a1644945aee124d621ce16dd) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:28.196360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591fddf-37ae-4917-b72b-141dd28d40e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:28.196766 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5edf42-7abd-4796-9bb6-ba95ecbb8046 None admin] RBAC: Authorizing `identity:get_group(group_id=43f1e96af8c24c6e9d473f63e5bccd86)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:28.197882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591fddf-37ae-4917-b72b-141dd28d40e6 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:28.198251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5edf42-7abd-4796-9bb6-ba95ecbb8046 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:28.200689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 186/378] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:27 2022] GET /identity/v3/groups/43f1e96af8c24c6e9d473f63e5bccd86 => generated 229 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:28.202067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457105-c6f6-4ff2-8e1f-d1669dfdd15b None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:28.202348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457105-c6f6-4ff2-8e1f-d1669dfdd15b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:28.202653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457105-c6f6-4ff2-8e1f-d1669dfdd15b None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:28.204163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 187/379] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:28.208612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 193/380] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 10:07:28 2022] GET /identity/v3/role_assignments?group.id=30c4a95995f64e39acec036fd8aa814c&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=26c081183cd3490c977d961b36b9cee4 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:28.209586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28cfea-786e-4713-96f3-73a8ce09f958 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:28.209872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28cfea-786e-4713-96f3-73a8ce09f958 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:28.210148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28cfea-786e-4713-96f3-73a8ce09f958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:28.210403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591fddf-37ae-4917-b72b-141dd28d40e6 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:28.271758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5d28cfea-786e-4713-96f3-73a8ce09f958 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:28.273055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5d28cfea-786e-4713-96f3-73a8ce09f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:28.307567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:28.339099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591fddf-37ae-4917-b72b-141dd28d40e6 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:28.366930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:28.381975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9257-1caf-4e00-b700-85d14571c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:28.382753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9257-1caf-4e00-b700-85d14571c011 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:28.383038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9257-1caf-4e00-b700-85d14571c011 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:28.383313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9257-1caf-4e00-b700-85d14571c011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:28.384816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f9257-1caf-4e00-b700-85d14571c011 None admin] RBAC: Adding query filter params (group.id=43f1e96af8c24c6e9d473f63e5bccd86, role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=5250969aacd849649f4438fde7d1550d) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:28.385133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f9257-1caf-4e00-b700-85d14571c011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:28.386952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f9257-1caf-4e00-b700-85d14571c011 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:28.394244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 194/381] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 10:07:28 2022] GET /identity/v3/role_assignments?group.id=43f1e96af8c24c6e9d473f63e5bccd86&scope.project.id=5250969aacd849649f4438fde7d1550d&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:28.416143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 188/382] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:28.440688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9257-1caf-4e00-b700-85d14571c011 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:28.583310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9257-1caf-4e00-b700-85d14571c011 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:28.635228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed6b6b-496e-4343-a468-38185d10c878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:28.636065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6b6b-496e-4343-a468-38185d10c878 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:28.636354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6b6b-496e-4343-a468-38185d10c878 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:28.636630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6b6b-496e-4343-a468-38185d10c878 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:28.652147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed6b6b-496e-4343-a468-38185d10c878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-85ed6b6b-496e-4343-a468-38185d10c878 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:28.660624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:28.661555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:28.662411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 195/383] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:28.668377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28cfea-786e-4713-96f3-73a8ce09f958 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:28.805825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28cfea-786e-4713-96f3-73a8ce09f958 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:28.856663 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752be073-ab45-4a4b-83c1-555bd090231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:28.857416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be073-ab45-4a4b-83c1-555bd090231d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:28.857701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be073-ab45-4a4b-83c1-555bd090231d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:28.857984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be073-ab45-4a4b-83c1-555bd090231d None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:28.858779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752be073-ab45-4a4b-83c1-555bd090231d None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:28.859091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752be073-ab45-4a4b-83c1-555bd090231d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:28.860545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752be073-ab45-4a4b-83c1-555bd090231d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:28.880822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 189/384] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:28.886925 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed6b6b-496e-4343-a468-38185d10c878 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:28.946907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:29.003700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed6b6b-496e-4343-a468-38185d10c878 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:29.055493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16467-21e4-495e-8b40-e8c3e5a67388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:29.056442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16467-21e4-495e-8b40-e8c3e5a67388 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:29.056666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16467-21e4-495e-8b40-e8c3e5a67388 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:29.056942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16467-21e4-495e-8b40-e8c3e5a67388 None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:29.063302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f16467-21e4-495e-8b40-e8c3e5a67388 None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:29.064814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f16467-21e4-495e-8b40-e8c3e5a67388 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:29.066634 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 196/385] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:28 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:29.067774 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e3ddc-9b89-4218-9776-388ee0e7076b None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:29.068063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e3ddc-9b89-4218-9776-388ee0e7076b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:29.068328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e3ddc-9b89-4218-9776-388ee0e7076b None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:29.071259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 190/386] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:29.072329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16467-21e4-495e-8b40-e8c3e5a67388 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:29.075535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c912a-9256-41c2-b4fd-688b242a74ce None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:29.075894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c912a-9256-41c2-b4fd-688b242a74ce None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:29.076169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c912a-9256-41c2-b4fd-688b242a74ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:29.093714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b57c912a-9256-41c2-b4fd-688b242a74ce None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:29.094937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b57c912a-9256-41c2-b4fd-688b242a74ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:29.128104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:29.208117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16467-21e4-495e-8b40-e8c3e5a67388 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:29.222884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:29.260939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 191/387] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:29.261613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7148-23d5-40fa-b03f-b992b7fe3a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:29.262524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7148-23d5-40fa-b03f-b992b7fe3a22 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:29.262813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7148-23d5-40fa-b03f-b992b7fe3a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:29.263111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7148-23d5-40fa-b03f-b992b7fe3a22 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:29.264352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a7148-23d5-40fa-b03f-b992b7fe3a22 None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:29.265810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a7148-23d5-40fa-b03f-b992b7fe3a22 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:29.267804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 197/388] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:29 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:29.273168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c912a-9256-41c2-b4fd-688b242a74ce None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:29.295351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7148-23d5-40fa-b03f-b992b7fe3a22 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:29.459906 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c912a-9256-41c2-b4fd-688b242a74ce None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:29.475178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7148-23d5-40fa-b03f-b992b7fe3a22 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:29.517144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aad2f-5832-4a98-81bc-0ca4290d671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:29.518140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aad2f-5832-4a98-81bc-0ca4290d671e None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:29.518548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aad2f-5832-4a98-81bc-0ca4290d671e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:29.518820 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aad2f-5832-4a98-81bc-0ca4290d671e None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/groups/30c4a95995f64e39acec036fd8aa814c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:29.521062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aad2f-5832-4a98-81bc-0ca4290d671e None admin] RBAC: Authorizing `identity:create_grant(project_id=2b645eb49c354c1c96fc1d2f25352d6e, group_id=30c4a95995f64e39acec036fd8aa814c, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:29.522681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aad2f-5832-4a98-81bc-0ca4290d671e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:29.527410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0e239-e2fb-4615-b7ca-6b35be574f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:29.528844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e239-e2fb-4615-b7ca-6b35be574f9e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:29.529400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e239-e2fb-4615-b7ca-6b35be574f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:29.529958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e239-e2fb-4615-b7ca-6b35be574f9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:29.542545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 192/389] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Jun 22 10:07:29 2022] PUT /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/groups/30c4a95995f64e39acec036fd8aa814c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:29.542545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e3f2-7177-4698-b22b-a434075ae1e3 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:29.542545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e3f2-7177-4698-b22b-a434075ae1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:29.542545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e3f2-7177-4698-b22b-a434075ae1e3 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:29.542545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 193/390] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:29.547906 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0e239-e2fb-4615-b7ca-6b35be574f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-94a0e239-e2fb-4615-b7ca-6b35be574f9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:29.556424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:29.557426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:29.558241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:29.564636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea2641-425e-474e-a33d-00ce3096f79d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:29.565010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea2641-425e-474e-a33d-00ce3096f79d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:29.565237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea2641-425e-474e-a33d-00ce3096f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:29.566729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 198/391] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:29.577244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0e239-e2fb-4615-b7ca-6b35be574f9e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:29.595913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3eea2641-425e-474e-a33d-00ce3096f79d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:29.597490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3eea2641-425e-474e-a33d-00ce3096f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:29.619753 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:29.667701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:29.701235 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 194/392] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:29.749249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea2641-425e-474e-a33d-00ce3096f79d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:29.775167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0e239-e2fb-4615-b7ca-6b35be574f9e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:29.814657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bc7c5-dd59-4a23-9445-4dd55c1e0e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:29.815336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc7c5-dd59-4a23-9445-4dd55c1e0e62 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:29.815775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc7c5-dd59-4a23-9445-4dd55c1e0e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:29.816206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc7c5-dd59-4a23-9445-4dd55c1e0e62 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:29.817093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bc7c5-dd59-4a23-9445-4dd55c1e0e62 None admin] RBAC: Adding query filter params (name=member) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:29.817544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bc7c5-dd59-4a23-9445-4dd55c1e0e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:29.819145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bc7c5-dd59-4a23-9445-4dd55c1e0e62 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:29.834652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 199/393] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:29.837106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bc7c5-dd59-4a23-9445-4dd55c1e0e62 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:29.896915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea2641-425e-474e-a33d-00ce3096f79d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:29.963299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7d0fa-fb78-4e05-86c4-79d95c3efff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:29.964123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7d0fa-fb78-4e05-86c4-79d95c3efff3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:29.964405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7d0fa-fb78-4e05-86c4-79d95c3efff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:29.964676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7d0fa-fb78-4e05-86c4-79d95c3efff3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:29.987716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7d0fa-fb78-4e05-86c4-79d95c3efff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b0e7d0fa-fb78-4e05-86c4-79d95c3efff3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:29.996298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:29.997237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:29.998165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:30.005826 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 195/394] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:30.007384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7d0fa-fb78-4e05-86c4-79d95c3efff3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:30.010552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:30.021570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:30.027267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bc7c5-dd59-4a23-9445-4dd55c1e0e62 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:30.101031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa24984-1dbb-43f8-a5d7-477c6130c8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:30.101910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa24984-1dbb-43f8-a5d7-477c6130c8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.102201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa24984-1dbb-43f8-a5d7-477c6130c8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.102467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa24984-1dbb-43f8-a5d7-477c6130c8c9 None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.107636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa24984-1dbb-43f8-a5d7-477c6130c8c9 None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:30.109131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa24984-1dbb-43f8-a5d7-477c6130c8c9 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:30.110840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 200/395] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:29 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:30.116384 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa24984-1dbb-43f8-a5d7-477c6130c8c9 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:30.210330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7d0fa-fb78-4e05-86c4-79d95c3efff3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:30.236803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa24984-1dbb-43f8-a5d7-477c6130c8c9 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:30.273146 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442485c6-c609-4c1e-8e47-685cbee4fb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:30.273328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d552668-58a1-4bbb-8812-c81e22025172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:30.273804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d552668-58a1-4bbb-8812-c81e22025172 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.273919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442485c6-c609-4c1e-8e47-685cbee4fb62 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.274095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d552668-58a1-4bbb-8812-c81e22025172 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.274275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442485c6-c609-4c1e-8e47-685cbee4fb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.274380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d552668-58a1-4bbb-8812-c81e22025172 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.274573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442485c6-c609-4c1e-8e47-685cbee4fb62 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.275124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d552668-58a1-4bbb-8812-c81e22025172 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:30.275430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d552668-58a1-4bbb-8812-c81e22025172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:30.275841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442485c6-c609-4c1e-8e47-685cbee4fb62 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:30.276801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d552668-58a1-4bbb-8812-c81e22025172 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:30.277426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442485c6-c609-4c1e-8e47-685cbee4fb62 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:30.280120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 201/396] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:30 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:30.291728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 196/397] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:30.296169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442485c6-c609-4c1e-8e47-685cbee4fb62 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:30.306260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d552668-58a1-4bbb-8812-c81e22025172 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:30.370872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:30.435670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:30.491732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442485c6-c609-4c1e-8e47-685cbee4fb62 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:30.493782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d552668-58a1-4bbb-8812-c81e22025172 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:30.528211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088c975-6189-4356-931e-58483dc534f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:30.529155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c975-6189-4356-931e-58483dc534f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.529496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c975-6189-4356-931e-58483dc534f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.529839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c975-6189-4356-931e-58483dc534f5 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd/groups/30c4a95995f64e39acec036fd8aa814c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.532370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088c975-6189-4356-931e-58483dc534f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=89fcb966a1644945aee124d621ce16dd, group_id=30c4a95995f64e39acec036fd8aa814c, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:30.534223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088c975-6189-4356-931e-58483dc534f5 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:30.538609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ba92a-c168-47da-85a2-d80a527dab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:30.539518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ba92a-c168-47da-85a2-d80a527dab4b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.539798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ba92a-c168-47da-85a2-d80a527dab4b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.540128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ba92a-c168-47da-85a2-d80a527dab4b None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.541277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ba92a-c168-47da-85a2-d80a527dab4b None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:30.542770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ba92a-c168-47da-85a2-d80a527dab4b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:30.545023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 197/398] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:30 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:30.546455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab562a2-eb5f-4396-bb9e-57c6733cf5ec None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.546764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab562a2-eb5f-4396-bb9e-57c6733cf5ec None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.547142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab562a2-eb5f-4396-bb9e-57c6733cf5ec None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.548327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 198/399] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:30.551663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 202/400] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Jun 22 10:07:30 2022] PUT /identity/v3/projects/89fcb966a1644945aee124d621ce16dd/groups/30c4a95995f64e39acec036fd8aa814c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:30.553273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab562a2-eb5f-4396-bb9e-57c6733cf5ec None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:30.555496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52c313-ca1b-4f1f-8198-19a31ad5e984 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.555959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52c313-ca1b-4f1f-8198-19a31ad5e984 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.556431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52c313-ca1b-4f1f-8198-19a31ad5e984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.581290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0a52c313-ca1b-4f1f-8198-19a31ad5e984 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:30.583001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0a52c313-ca1b-4f1f-8198-19a31ad5e984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:30.663353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 203/401] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:30.696617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab562a2-eb5f-4396-bb9e-57c6733cf5ec None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:30.732705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52c313-ca1b-4f1f-8198-19a31ad5e984 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:30.750550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:30.758913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e669c-b977-4636-b46e-ab20df4edcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:30.760761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e669c-b977-4636-b46e-ab20df4edcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.761041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e669c-b977-4636-b46e-ab20df4edcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.761555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e669c-b977-4636-b46e-ab20df4edcd7 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.764615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e669c-b977-4636-b46e-ab20df4edcd7 None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:30.766431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e669c-b977-4636-b46e-ab20df4edcd7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:30.771180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 199/402] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:30 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:30.775542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e669c-b977-4636-b46e-ab20df4edcd7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:30.795364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:30.908613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52c313-ca1b-4f1f-8198-19a31ad5e984 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:30.932506 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e669c-b977-4636-b46e-ab20df4edcd7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:30.953783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895f6a4-11bc-4d5b-823e-16dacbc19e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:30.954590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f6a4-11bc-4d5b-823e-16dacbc19e40 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.955064 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f6a4-11bc-4d5b-823e-16dacbc19e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.955417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f6a4-11bc-4d5b-823e-16dacbc19e40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.967241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895f6a4-11bc-4d5b-823e-16dacbc19e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-1895f6a4-11bc-4d5b-823e-16dacbc19e40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:30.976014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:30.977160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:30.978165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:30.980151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 204/403] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:30.980929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbd8ff-0ddd-4138-93a0-d0f1a4bc031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:30.981606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0558b84-613a-42ae-8888-40fcf8e8b0f3 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.982098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0558b84-613a-42ae-8888-40fcf8e8b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.982362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbd8ff-0ddd-4138-93a0-d0f1a4bc031f None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:30.982608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0558b84-613a-42ae-8888-40fcf8e8b0f3 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.982988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbd8ff-0ddd-4138-93a0-d0f1a4bc031f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:30.983402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbd8ff-0ddd-4138-93a0-d0f1a4bc031f None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/groups/30c4a95995f64e39acec036fd8aa814c/roles/26c081183cd3490c977d961b36b9cee4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:30.984509 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 205/404] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:30.986083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbd8ff-0ddd-4138-93a0-d0f1a4bc031f None admin] RBAC: Authorizing `identity:create_grant(project_id=2b645eb49c354c1c96fc1d2f25352d6e, group_id=30c4a95995f64e39acec036fd8aa814c, role_id=26c081183cd3490c977d961b36b9cee4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:30.986214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0558b84-613a-42ae-8888-40fcf8e8b0f3 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:30.987831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbd8ff-0ddd-4138-93a0-d0f1a4bc031f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:31.007275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 200/405] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Jun 22 10:07:30 2022] PUT /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e/groups/30c4a95995f64e39acec036fd8aa814c/roles/26c081183cd3490c977d961b36b9cee4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:31.009114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e10570-b157-4f4c-b8c6-9ca547fde3e7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:31.009618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e10570-b157-4f4c-b8c6-9ca547fde3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:31.010123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e10570-b157-4f4c-b8c6-9ca547fde3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:31.031894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-75e10570-b157-4f4c-b8c6-9ca547fde3e7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:31.034390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-75e10570-b157-4f4c-b8c6-9ca547fde3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:31.154875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:31.179022 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:31.181005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 201/406] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:31.215694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0558b84-613a-42ae-8888-40fcf8e8b0f3 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:31.227457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e10570-b157-4f4c-b8c6-9ca547fde3e7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:31.264058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566855c-7ed2-4dd2-a5d0-8da3167cb207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:31.265308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566855c-7ed2-4dd2-a5d0-8da3167cb207 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:31.265596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566855c-7ed2-4dd2-a5d0-8da3167cb207 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:31.265868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566855c-7ed2-4dd2-a5d0-8da3167cb207 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:31.266661 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566855c-7ed2-4dd2-a5d0-8da3167cb207 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:31.266969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566855c-7ed2-4dd2-a5d0-8da3167cb207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:31.269346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566855c-7ed2-4dd2-a5d0-8da3167cb207 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:31.280805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 206/407] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:31.286455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566855c-7ed2-4dd2-a5d0-8da3167cb207 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:31.353539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e10570-b157-4f4c-b8c6-9ca547fde3e7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:31.398926 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4504d-ee7b-4c2f-83e3-87c94f8952f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:31.399915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4504d-ee7b-4c2f-83e3-87c94f8952f3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:31.400549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4504d-ee7b-4c2f-83e3-87c94f8952f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:31.400840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4504d-ee7b-4c2f-83e3-87c94f8952f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:31.410301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566855c-7ed2-4dd2-a5d0-8da3167cb207 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:31.415441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4504d-ee7b-4c2f-83e3-87c94f8952f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-f7f4504d-ee7b-4c2f-83e3-87c94f8952f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:31.425145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:31.426156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:31.427004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:31.427649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 202/408] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:31.433525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4504d-ee7b-4c2f-83e3-87c94f8952f3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:31.453010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b944e-ae86-4eb8-b0e7-fa6e96775c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:31.458050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b944e-ae86-4eb8-b0e7-fa6e96775c49 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:31.458050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b944e-ae86-4eb8-b0e7-fa6e96775c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:31.458050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b944e-ae86-4eb8-b0e7-fa6e96775c49 None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:31.458050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b944e-ae86-4eb8-b0e7-fa6e96775c49 None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:31.458050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b944e-ae86-4eb8-b0e7-fa6e96775c49 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:31.459872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 207/409] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:31 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:31.466540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b944e-ae86-4eb8-b0e7-fa6e96775c49 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:31.485409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:31.488509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:31.542803 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4504d-ee7b-4c2f-83e3-87c94f8952f3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:31.579727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523076a-effc-44de-8093-704efdeef61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:31.580534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523076a-effc-44de-8093-704efdeef61b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:31.580898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523076a-effc-44de-8093-704efdeef61b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:31.581234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523076a-effc-44de-8093-704efdeef61b None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:31.582071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523076a-effc-44de-8093-704efdeef61b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:31.582441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523076a-effc-44de-8093-704efdeef61b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:31.583940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523076a-effc-44de-8093-704efdeef61b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:31.593602 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 203/410] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:31.599370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523076a-effc-44de-8093-704efdeef61b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:31.611759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b944e-ae86-4eb8-b0e7-fa6e96775c49 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:31.727521 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8377ae-16c2-4363-80e0-5148a0e2f766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:31.728442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8377ae-16c2-4363-80e0-5148a0e2f766 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:31.728770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8377ae-16c2-4363-80e0-5148a0e2f766 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:31.729074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8377ae-16c2-4363-80e0-5148a0e2f766 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:31.734948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523076a-effc-44de-8093-704efdeef61b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:31.735837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8377ae-16c2-4363-80e0-5148a0e2f766 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:31.737495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8377ae-16c2-4363-80e0-5148a0e2f766 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:31.739754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 208/411] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:31 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:31.745922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8377ae-16c2-4363-80e0-5148a0e2f766 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:31.762732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:31.775752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482782af-f036-4319-8998-c8c9aada0372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:31.776879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482782af-f036-4319-8998-c8c9aada0372 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:31.777303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482782af-f036-4319-8998-c8c9aada0372 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:31.777727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482782af-f036-4319-8998-c8c9aada0372 None admin] PATH_INFO: `/v3/groups/43f1e96af8c24c6e9d473f63e5bccd86` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:31.779421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482782af-f036-4319-8998-c8c9aada0372 None admin] RBAC: Authorizing `identity:get_group(group_id=43f1e96af8c24c6e9d473f63e5bccd86)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:31.780956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482782af-f036-4319-8998-c8c9aada0372 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:31.783536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 204/412] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:31 2022] GET /identity/v3/groups/43f1e96af8c24c6e9d473f63e5bccd86 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:31.789285 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482782af-f036-4319-8998-c8c9aada0372 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:31.860308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:31.879391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8377ae-16c2-4363-80e0-5148a0e2f766 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:31.918164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b89ff-34ad-4a4d-bb04-3969b0fa0063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:31.919094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b89ff-34ad-4a4d-bb04-3969b0fa0063 None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:31.919439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b89ff-34ad-4a4d-bb04-3969b0fa0063 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:31.919724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b89ff-34ad-4a4d-bb04-3969b0fa0063 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd/groups/30c4a95995f64e39acec036fd8aa814c/roles/26c081183cd3490c977d961b36b9cee4` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:31.926140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b89ff-34ad-4a4d-bb04-3969b0fa0063 None admin] RBAC: Authorizing `identity:create_grant(project_id=89fcb966a1644945aee124d621ce16dd, group_id=30c4a95995f64e39acec036fd8aa814c, role_id=26c081183cd3490c977d961b36b9cee4)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:31.927664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b89ff-34ad-4a4d-bb04-3969b0fa0063 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:31.952181 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 209/413] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Jun 22 10:07:31 2022] PUT /identity/v3/projects/89fcb966a1644945aee124d621ce16dd/groups/30c4a95995f64e39acec036fd8aa814c/roles/26c081183cd3490c977d961b36b9cee4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:07:31.988958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482782af-f036-4319-8998-c8c9aada0372 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:32.043791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21581c6-40d5-48e9-9e72-8c674fda73ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:32.044978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21581c6-40d5-48e9-9e72-8c674fda73ef None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:32.045256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21581c6-40d5-48e9-9e72-8c674fda73ef None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:32.045529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21581c6-40d5-48e9-9e72-8c674fda73ef None admin] PATH_INFO: `/v3/projects/5250969aacd849649f4438fde7d1550d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:32.046824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21581c6-40d5-48e9-9e72-8c674fda73ef None admin] RBAC: Authorizing `identity:get_project(project_id=5250969aacd849649f4438fde7d1550d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:32.048315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21581c6-40d5-48e9-9e72-8c674fda73ef None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:32.050321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 205/414] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:31 2022] GET /identity/v3/projects/5250969aacd849649f4438fde7d1550d => generated 344 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:32.056265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b89ff-34ad-4a4d-bb04-3969b0fa0063 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:32.164154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b89ff-34ad-4a4d-bb04-3969b0fa0063 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:32.202579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f469bc2-c22d-4d4d-aaf4-6b77c0d75cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:32.203474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469bc2-c22d-4d4d-aaf4-6b77c0d75cac None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:32.203751 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469bc2-c22d-4d4d-aaf4-6b77c0d75cac None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:32.204071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469bc2-c22d-4d4d-aaf4-6b77c0d75cac None admin] PATH_INFO: `/v3/projects/5250969aacd849649f4438fde7d1550d/groups/43f1e96af8c24c6e9d473f63e5bccd86/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:32.206050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f469bc2-c22d-4d4d-aaf4-6b77c0d75cac None admin] RBAC: Authorizing `identity:create_grant(project_id=5250969aacd849649f4438fde7d1550d, group_id=43f1e96af8c24c6e9d473f63e5bccd86, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:32.207587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f469bc2-c22d-4d4d-aaf4-6b77c0d75cac None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:32.226669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 210/415] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Jun 22 10:07:32 2022] PUT /identity/v3/projects/5250969aacd849649f4438fde7d1550d/groups/43f1e96af8c24c6e9d473f63e5bccd86/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:32.342842 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837334-9b16-45da-ac6a-3d041a9c2d12 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:32.343150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837334-9b16-45da-ac6a-3d041a9c2d12 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:32.343357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837334-9b16-45da-ac6a-3d041a9c2d12 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:32.345186 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 206/416] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:32.351676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243d81-1589-4e6e-ba6a-666a2cefe5bc None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:32.351973 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243d81-1589-4e6e-ba6a-666a2cefe5bc None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:32.352261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243d81-1589-4e6e-ba6a-666a2cefe5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:32.357950 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:32.374056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e1243d81-1589-4e6e-ba6a-666a2cefe5bc None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:32.375403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e1243d81-1589-4e6e-ba6a-666a2cefe5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:32.454854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 211/417] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:32.481872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b837334-9b16-45da-ac6a-3d041a9c2d12 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:32.552385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:32.620569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b837334-9b16-45da-ac6a-3d041a9c2d12 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:32.669677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640fe06-8361-4fa2-85d3-91b1e07b0a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:32.670475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640fe06-8361-4fa2-85d3-91b1e07b0a33 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:32.670777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640fe06-8361-4fa2-85d3-91b1e07b0a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:32.671046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640fe06-8361-4fa2-85d3-91b1e07b0a33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:32.685820 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640fe06-8361-4fa2-85d3-91b1e07b0a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8640fe06-8361-4fa2-85d3-91b1e07b0a33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:32.693841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:32.694770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:32.695636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:32.697849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 207/418] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:32.702910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1243d81-1589-4e6e-ba6a-666a2cefe5bc None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:32.831952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1243d81-1589-4e6e-ba6a-666a2cefe5bc None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:32.871751 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:32.881063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd566b77-1cc3-4cdf-ae8f-7ea61c663670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:32.881808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd566b77-1cc3-4cdf-ae8f-7ea61c663670 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:32.882091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd566b77-1cc3-4cdf-ae8f-7ea61c663670 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:32.882368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd566b77-1cc3-4cdf-ae8f-7ea61c663670 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:32.883167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd566b77-1cc3-4cdf-ae8f-7ea61c663670 None admin] RBAC: Adding query filter params (name=member) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:32.883478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd566b77-1cc3-4cdf-ae8f-7ea61c663670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:32.884875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd566b77-1cc3-4cdf-ae8f-7ea61c663670 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:32.894145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 212/419] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:32.899980 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640fe06-8361-4fa2-85d3-91b1e07b0a33 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:33.082182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640fe06-8361-4fa2-85d3-91b1e07b0a33 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:33.090530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c0df1-8aa3-4487-89f9-8a506a047d57 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:33.090530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c0df1-8aa3-4487-89f9-8a506a047d57 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:33.090530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c0df1-8aa3-4487-89f9-8a506a047d57 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:33.090530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 213/420] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:33.103154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8993e-af09-435c-b873-f543988ba2df None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:33.103491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8993e-af09-435c-b873-f543988ba2df None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:33.103722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8993e-af09-435c-b873-f543988ba2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:33.104667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:33.128426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a5f8993e-af09-435c-b873-f543988ba2df None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:33.129573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a5f8993e-af09-435c-b873-f543988ba2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:33.159799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68647da7-0429-4f81-a3c1-cc96f71938df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:33.160459 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68647da7-0429-4f81-a3c1-cc96f71938df None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:33.160740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68647da7-0429-4f81-a3c1-cc96f71938df None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:33.161018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68647da7-0429-4f81-a3c1-cc96f71938df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:33.262884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 214/421] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:33.276540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68647da7-0429-4f81-a3c1-cc96f71938df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:33.278430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68647da7-0429-4f81-a3c1-cc96f71938df None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:33.294525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8993e-af09-435c-b873-f543988ba2df None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:33.402612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8993e-af09-435c-b873-f543988ba2df None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:33.427667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:33.445417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33549dc-ceb0-4d60-bad0-1bcfb0d0a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:33.446247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33549dc-ceb0-4d60-bad0-1bcfb0d0a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:33.446552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33549dc-ceb0-4d60-bad0-1bcfb0d0a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:33.446836 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33549dc-ceb0-4d60-bad0-1bcfb0d0a5c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:33.459465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33549dc-ceb0-4d60-bad0-1bcfb0d0a5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-d33549dc-ceb0-4d60-bad0-1bcfb0d0a5c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:33.467878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:33.468872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:33.469806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 215/422] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:33.474609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33549dc-ceb0-4d60-bad0-1bcfb0d0a5c5 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:33.498586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 208/423] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:33.504470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68647da7-0429-4f81-a3c1-cc96f71938df None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:33.538883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:33.586057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33549dc-ceb0-4d60-bad0-1bcfb0d0a5c5 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:33.623923 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54373f-12f1-4844-b903-931b4b2d483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:33.624423 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54373f-12f1-4844-b903-931b4b2d483e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:33.624709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54373f-12f1-4844-b903-931b4b2d483e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:33.624990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54373f-12f1-4844-b903-931b4b2d483e None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:33.625754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54373f-12f1-4844-b903-931b4b2d483e None admin] RBAC: Adding query filter params (name=member) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:33.626126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54373f-12f1-4844-b903-931b4b2d483e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:33.627583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54373f-12f1-4844-b903-931b4b2d483e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:33.631717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68647da7-0429-4f81-a3c1-cc96f71938df None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:33.641522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 216/424] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:07:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:33.642948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342de2a-5f0d-463a-a71b-f6406274fe25 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:33.643250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342de2a-5f0d-463a-a71b-f6406274fe25 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:33.643535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342de2a-5f0d-463a-a71b-f6406274fe25 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:33.644869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 217/425] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:33.649135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342de2a-5f0d-463a-a71b-f6406274fe25 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:33.689663 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946e129-765b-4d7b-9e54-43a5fa58a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:33.690895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e129-765b-4d7b-9e54-43a5fa58a335 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:33.691336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e129-765b-4d7b-9e54-43a5fa58a335 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:33.691771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e129-765b-4d7b-9e54-43a5fa58a335 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:33.693169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946e129-765b-4d7b-9e54-43a5fa58a335 None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:33.696201 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946e129-765b-4d7b-9e54-43a5fa58a335 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:33.699523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 209/426] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:33 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:33.702027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:33.703400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4351c0-e848-4ac1-8211-bf1e861a9c52 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:33.703968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4351c0-e848-4ac1-8211-bf1e861a9c52 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:33.704560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4351c0-e848-4ac1-8211-bf1e861a9c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:33.727248 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-eb4351c0-e848-4ac1-8211-bf1e861a9c52 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:33.728509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eb4351c0-e848-4ac1-8211-bf1e861a9c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:33.774691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342de2a-5f0d-463a-a71b-f6406274fe25 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:33.820837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e48e5-a8a3-42f7-b860-8e2305786045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:33.822136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e48e5-a8a3-42f7-b860-8e2305786045 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:33.822664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e48e5-a8a3-42f7-b860-8e2305786045 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:33.823255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e48e5-a8a3-42f7-b860-8e2305786045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:33.823466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 210/427] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:33.824366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4351c0-e848-4ac1-8211-bf1e861a9c52 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:33.835159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:33.904196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e48e5-a8a3-42f7-b860-8e2305786045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:33.906218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e48e5-a8a3-42f7-b860-8e2305786045 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:33.946890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4351c0-e848-4ac1-8211-bf1e861a9c52 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:33.959427 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:33.985326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e4fd7-4d9a-43c4-af00-58fed3a5ca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:33.986178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e4fd7-4d9a-43c4-af00-58fed3a5ca92 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:33.986613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e4fd7-4d9a-43c4-af00-58fed3a5ca92 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:33.986899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e4fd7-4d9a-43c4-af00-58fed3a5ca92 None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:33.988573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e4fd7-4d9a-43c4-af00-58fed3a5ca92 None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:33.990020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e4fd7-4d9a-43c4-af00-58fed3a5ca92 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:33.997477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 211/428] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:33 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:33.997477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e4fd7-4d9a-43c4-af00-58fed3a5ca92 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:34.034695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 218/429] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:34.035712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e48e5-a8a3-42f7-b860-8e2305786045 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:34.103939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:34.141272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e4fd7-4d9a-43c4-af00-58fed3a5ca92 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:34.146720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e48e5-a8a3-42f7-b860-8e2305786045 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:34.186908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cc299-6ee5-4d51-8a44-b8847f7d73c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:34.187749 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cc299-6ee5-4d51-8a44-b8847f7d73c1 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.188141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cc299-6ee5-4d51-8a44-b8847f7d73c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.188513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cc299-6ee5-4d51-8a44-b8847f7d73c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.189467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cc299-6ee5-4d51-8a44-b8847f7d73c1 None admin] RBAC: Adding query filter params (group.id=30c4a95995f64e39acec036fd8aa814c, role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:34.189796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fee995-6e1c-4ba2-9120-2ca4ba1b002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:34.189931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cc299-6ee5-4d51-8a44-b8847f7d73c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:34.190970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fee995-6e1c-4ba2-9120-2ca4ba1b002a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.191428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fee995-6e1c-4ba2-9120-2ca4ba1b002a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.191844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fee995-6e1c-4ba2-9120-2ca4ba1b002a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.191972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cc299-6ee5-4d51-8a44-b8847f7d73c1 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:34.199447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 219/430] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 10:07:34 2022] GET /identity/v3/role_assignments?group.id=30c4a95995f64e39acec036fd8aa814c&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:34.200474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cc299-6ee5-4d51-8a44-b8847f7d73c1 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:34.207849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fee995-6e1c-4ba2-9120-2ca4ba1b002a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:34.213671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-19fee995-6e1c-4ba2-9120-2ca4ba1b002a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:34.221438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:34.222806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:34.223938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:34.227082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 212/431] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:34.233113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fee995-6e1c-4ba2-9120-2ca4ba1b002a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:34.328652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cc299-6ee5-4d51-8a44-b8847f7d73c1 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:34.368688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1665e-a1fb-48ab-a864-3d39d032a16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:34.374541 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1665e-a1fb-48ab-a864-3d39d032a16b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.374541 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1665e-a1fb-48ab-a864-3d39d032a16b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.374541 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1665e-a1fb-48ab-a864-3d39d032a16b None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.375998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1665e-a1fb-48ab-a864-3d39d032a16b None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:34.380379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1665e-a1fb-48ab-a864-3d39d032a16b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:34.385173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 220/432] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:34 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:34.386060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1665e-a1fb-48ab-a864-3d39d032a16b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:34.442318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fee995-6e1c-4ba2-9120-2ca4ba1b002a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:34.506355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4b1e4-4b3c-4bda-97b4-7d4713f9cf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:34.506973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4b1e4-4b3c-4bda-97b4-7d4713f9cf7a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.507320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4b1e4-4b3c-4bda-97b4-7d4713f9cf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.507592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4b1e4-4b3c-4bda-97b4-7d4713f9cf7a None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.508476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4b1e4-4b3c-4bda-97b4-7d4713f9cf7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:34.508782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4b1e4-4b3c-4bda-97b4-7d4713f9cf7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:34.510252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4b1e4-4b3c-4bda-97b4-7d4713f9cf7a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:34.511832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:34.522292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 213/433] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:34.527030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4b1e4-4b3c-4bda-97b4-7d4713f9cf7a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:34.535911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:34.568073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1665e-a1fb-48ab-a864-3d39d032a16b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:34.615207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c206b-1fd8-47b2-ad7f-8ecac4c2370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:34.616354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c206b-1fd8-47b2-ad7f-8ecac4c2370b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.616772 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c206b-1fd8-47b2-ad7f-8ecac4c2370b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.617173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c206b-1fd8-47b2-ad7f-8ecac4c2370b None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.620556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c206b-1fd8-47b2-ad7f-8ecac4c2370b None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:34.622365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c206b-1fd8-47b2-ad7f-8ecac4c2370b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:34.624802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 221/434] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:34 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:34.630261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c206b-1fd8-47b2-ad7f-8ecac4c2370b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:34.650383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4b1e4-4b3c-4bda-97b4-7d4713f9cf7a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:34.692258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a7245-e029-42b0-8679-a7eddf6b7b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:34.692919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a7245-e029-42b0-8679-a7eddf6b7b89 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.693201 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a7245-e029-42b0-8679-a7eddf6b7b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.693471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a7245-e029-42b0-8679-a7eddf6b7b89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.768626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c206b-1fd8-47b2-ad7f-8ecac4c2370b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:34.769928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:34.777904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a7245-e029-42b0-8679-a7eddf6b7b89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:34.779656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a7245-e029-42b0-8679-a7eddf6b7b89 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:34.811820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f257d-ca10-4159-bec3-b0a229fd9804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:34.815167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f257d-ca10-4159-bec3-b0a229fd9804 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.815167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f257d-ca10-4159-bec3-b0a229fd9804 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.815167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f257d-ca10-4159-bec3-b0a229fd9804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.815167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f257d-ca10-4159-bec3-b0a229fd9804 None admin] RBAC: Adding query filter params (group.id=30c4a95995f64e39acec036fd8aa814c, role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232, scope.project.id=89fcb966a1644945aee124d621ce16dd) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:34.815167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f257d-ca10-4159-bec3-b0a229fd9804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:34.815704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f257d-ca10-4159-bec3-b0a229fd9804 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:34.824978 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 222/435] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 10:07:34 2022] GET /identity/v3/role_assignments?group.id=30c4a95995f64e39acec036fd8aa814c&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:34.826378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb738d6-fbaf-48ad-96f2-96a1bd5f96b9 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.826700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb738d6-fbaf-48ad-96f2-96a1bd5f96b9 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.826984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb738d6-fbaf-48ad-96f2-96a1bd5f96b9 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.829017 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 223/436] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:34.830845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ab8c-8bac-4570-8ec3-32913d3bb7b4 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.831138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ab8c-8bac-4570-8ec3-32913d3bb7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.831775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ab8c-8bac-4570-8ec3-32913d3bb7b4 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.833500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 224/437] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:34.835777 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca01e7-126c-4262-8b5b-d111921fbb49 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.836170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca01e7-126c-4262-8b5b-d111921fbb49 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.836514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca01e7-126c-4262-8b5b-d111921fbb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.859569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b2ca01e7-126c-4262-8b5b-d111921fbb49 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:34.862844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b2ca01e7-126c-4262-8b5b-d111921fbb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:34.866542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:34.924505 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 214/438] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:34.924505 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594ef17-5f58-4847-8c80-0a70d88f0ec1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:34.924505 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594ef17-5f58-4847-8c80-0a70d88f0ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:34.924505 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594ef17-5f58-4847-8c80-0a70d88f0ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:34.946814 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9594ef17-5f58-4847-8c80-0a70d88f0ec1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:34.958731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 225/439] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:34.958940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9594ef17-5f58-4847-8c80-0a70d88f0ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:34.959034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca01e7-126c-4262-8b5b-d111921fbb49 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:35.038452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 215/440] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:35.039735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594ef17-5f58-4847-8c80-0a70d88f0ec1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:35.074220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:35.087613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca01e7-126c-4262-8b5b-d111921fbb49 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:35.124830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070f093-ecc6-4f7b-90ac-6d163f6dcd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:35.125701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070f093-ecc6-4f7b-90ac-6d163f6dcd06 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:35.125983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070f093-ecc6-4f7b-90ac-6d163f6dcd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:35.126249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070f093-ecc6-4f7b-90ac-6d163f6dcd06 None admin] PATH_INFO: `/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:35.127535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070f093-ecc6-4f7b-90ac-6d163f6dcd06 None admin] RBAC: Authorizing `identity:get_project(project_id=2b645eb49c354c1c96fc1d2f25352d6e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:35.129009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070f093-ecc6-4f7b-90ac-6d163f6dcd06 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:35.130736 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 226/441] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:34 2022] GET /identity/v3/projects/2b645eb49c354c1c96fc1d2f25352d6e => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:35.132848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070f093-ecc6-4f7b-90ac-6d163f6dcd06 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:35.146723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:35.160944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594ef17-5f58-4847-8c80-0a70d88f0ec1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:35.208334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16b19-5b98-4e3e-99e0-fd761191fa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:35.209619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16b19-5b98-4e3e-99e0-fd761191fa9b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:35.210075 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16b19-5b98-4e3e-99e0-fd761191fa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:35.210562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16b19-5b98-4e3e-99e0-fd761191fa9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:35.228872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f16b19-5b98-4e3e-99e0-fd761191fa9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-e8f16b19-5b98-4e3e-99e0-fd761191fa9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:35.243464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:35.244715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:35.245741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 216/442] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:35.246905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16b19-5b98-4e3e-99e0-fd761191fa9b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:35.257654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070f093-ecc6-4f7b-90ac-6d163f6dcd06 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:35.295049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf2efb-7f4d-458a-a984-27db21e07845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:35.295782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf2efb-7f4d-458a-a984-27db21e07845 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:35.296059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf2efb-7f4d-458a-a984-27db21e07845 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:35.296345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf2efb-7f4d-458a-a984-27db21e07845 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:35.306889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf2efb-7f4d-458a-a984-27db21e07845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-eabf2efb-7f4d-458a-a984-27db21e07845 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:35.315074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:35.316004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:35.316875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 227/443] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:35.317675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf2efb-7f4d-458a-a984-27db21e07845 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:35.334666 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:35.350308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16b19-5b98-4e3e-99e0-fd761191fa9b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:35.383177 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3302e-2ab2-4b8b-a93f-7682c8825d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:35.384036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3302e-2ab2-4b8b-a93f-7682c8825d61 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:35.384318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3302e-2ab2-4b8b-a93f-7682c8825d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:35.384591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3302e-2ab2-4b8b-a93f-7682c8825d61 None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:35.385777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3302e-2ab2-4b8b-a93f-7682c8825d61 None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:35.387260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3302e-2ab2-4b8b-a93f-7682c8825d61 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:35.388918 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 217/444] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:35 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:35.389672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3302e-2ab2-4b8b-a93f-7682c8825d61 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:35.395684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:35.431393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf2efb-7f4d-458a-a984-27db21e07845 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:35.465607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f27ae-22a0-47b6-8025-fe3d829d47d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:35.466312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f27ae-22a0-47b6-8025-fe3d829d47d6 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:35.466659 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f27ae-22a0-47b6-8025-fe3d829d47d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:35.466946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f27ae-22a0-47b6-8025-fe3d829d47d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:35.467780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f27ae-22a0-47b6-8025-fe3d829d47d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:35.468097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f27ae-22a0-47b6-8025-fe3d829d47d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:35.469543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f27ae-22a0-47b6-8025-fe3d829d47d6 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:35.480709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 228/445] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:35.481527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f27ae-22a0-47b6-8025-fe3d829d47d6 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:35.496884 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3302e-2ab2-4b8b-a93f-7682c8825d61 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:35.530132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6c9a6-5c4b-4cdf-892b-a255e81fc539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:35.530926 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6c9a6-5c4b-4cdf-892b-a255e81fc539 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:35.531204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6c9a6-5c4b-4cdf-892b-a255e81fc539 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:35.531473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6c9a6-5c4b-4cdf-892b-a255e81fc539 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:35.532230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6c9a6-5c4b-4cdf-892b-a255e81fc539 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:35.532533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6c9a6-5c4b-4cdf-892b-a255e81fc539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:35.534214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6c9a6-5c4b-4cdf-892b-a255e81fc539 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:35.542721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 218/446] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:35.543561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6c9a6-5c4b-4cdf-892b-a255e81fc539 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:35.563997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:35.584686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f27ae-22a0-47b6-8025-fe3d829d47d6 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:35.614978 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:35.626178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e7c35-869e-41e6-ad38-82705db4cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:35.627129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7c35-869e-41e6-ad38-82705db4cd86 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:35.627545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7c35-869e-41e6-ad38-82705db4cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:35.628254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7c35-869e-41e6-ad38-82705db4cd86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:35.629607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e7c35-869e-41e6-ad38-82705db4cd86 None admin] RBAC: Adding query filter params (group.id=30c4a95995f64e39acec036fd8aa814c, role.id=26c081183cd3490c977d961b36b9cee4, scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:35.630247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e7c35-869e-41e6-ad38-82705db4cd86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:35.633548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e7c35-869e-41e6-ad38-82705db4cd86 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:35.641154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 229/447] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 10:07:35 2022] GET /identity/v3/role_assignments?group.id=30c4a95995f64e39acec036fd8aa814c&scope.project.id=2b645eb49c354c1c96fc1d2f25352d6e&role.id=26c081183cd3490c977d961b36b9cee4 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:35.641911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e7c35-869e-41e6-ad38-82705db4cd86 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:35.668197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6c9a6-5c4b-4cdf-892b-a255e81fc539 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:35.723162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcc2df-c6fe-4173-beca-f6a1f4f799e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:35.723956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcc2df-c6fe-4173-beca-f6a1f4f799e2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:35.724298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcc2df-c6fe-4173-beca-f6a1f4f799e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:35.724671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcc2df-c6fe-4173-beca-f6a1f4f799e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:35.777766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e7c35-869e-41e6-ad38-82705db4cd86 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:35.822144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7842b-ee9f-44be-8a17-d5b339760a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:35.822754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7842b-ee9f-44be-8a17-d5b339760a1c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:35.823041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7842b-ee9f-44be-8a17-d5b339760a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:35.823352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7842b-ee9f-44be-8a17-d5b339760a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:35.829403 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcc2df-c6fe-4173-beca-f6a1f4f799e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:35.831339 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcc2df-c6fe-4173-beca-f6a1f4f799e2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:35.860371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:35.915079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:35.924739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7842b-ee9f-44be-8a17-d5b339760a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:35.926242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7842b-ee9f-44be-8a17-d5b339760a1c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:35.976685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 219/448] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:35.983754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcc2df-c6fe-4173-beca-f6a1f4f799e2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:36.053767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 230/449] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:36.059891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7842b-ee9f-44be-8a17-d5b339760a1c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:36.106220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcc2df-c6fe-4173-beca-f6a1f4f799e2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:36.133152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:36.158875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57fa0a-5e59-412d-9ba7-2dcca6da89a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:36.160021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57fa0a-5e59-412d-9ba7-2dcca6da89a2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:36.160021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57fa0a-5e59-412d-9ba7-2dcca6da89a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:36.160262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57fa0a-5e59-412d-9ba7-2dcca6da89a2 None admin] PATH_INFO: `/v3/projects/5250969aacd849649f4438fde7d1550d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:36.161656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57fa0a-5e59-412d-9ba7-2dcca6da89a2 None admin] RBAC: Authorizing `identity:get_project(project_id=5250969aacd849649f4438fde7d1550d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:36.163316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57fa0a-5e59-412d-9ba7-2dcca6da89a2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:36.165242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 220/450] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:35 2022] GET /identity/v3/projects/5250969aacd849649f4438fde7d1550d => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:36.171270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57fa0a-5e59-412d-9ba7-2dcca6da89a2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:36.187622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:36.197018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7842b-ee9f-44be-8a17-d5b339760a1c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:36.237132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9ed4b-1603-4237-bcfb-c299cd05d4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:36.238080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9ed4b-1603-4237-bcfb-c299cd05d4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:36.238364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9ed4b-1603-4237-bcfb-c299cd05d4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:36.238680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9ed4b-1603-4237-bcfb-c299cd05d4d4 None admin] PATH_INFO: `/v3/projects/89fcb966a1644945aee124d621ce16dd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:36.240009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9ed4b-1603-4237-bcfb-c299cd05d4d4 None admin] RBAC: Authorizing `identity:get_project(project_id=89fcb966a1644945aee124d621ce16dd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:36.241525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9ed4b-1603-4237-bcfb-c299cd05d4d4 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:36.243402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 231/451] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:07:36 2022] GET /identity/v3/projects/89fcb966a1644945aee124d621ce16dd => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:36.249158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9ed4b-1603-4237-bcfb-c299cd05d4d4 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:36.294863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57fa0a-5e59-412d-9ba7-2dcca6da89a2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:36.330515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb062f6-dd3e-43a8-a3d9-ba1e83c651d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:36.331421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb062f6-dd3e-43a8-a3d9-ba1e83c651d0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:36.331701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb062f6-dd3e-43a8-a3d9-ba1e83c651d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:36.331995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb062f6-dd3e-43a8-a3d9-ba1e83c651d0 None admin] PATH_INFO: `/v3/groups/43f1e96af8c24c6e9d473f63e5bccd86` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:36.333245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb062f6-dd3e-43a8-a3d9-ba1e83c651d0 None admin] RBAC: Authorizing `identity:get_group(group_id=43f1e96af8c24c6e9d473f63e5bccd86)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:36.334760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb062f6-dd3e-43a8-a3d9-ba1e83c651d0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:36.336401 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 221/452] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:36 2022] GET /identity/v3/groups/43f1e96af8c24c6e9d473f63e5bccd86 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:36.342323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb062f6-dd3e-43a8-a3d9-ba1e83c651d0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:36.354402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9ed4b-1603-4237-bcfb-c299cd05d4d4 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:36.390313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52b6d7-1981-47d9-8550-d321f2123926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:36.391189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52b6d7-1981-47d9-8550-d321f2123926 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:36.391469 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52b6d7-1981-47d9-8550-d321f2123926 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:36.391748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52b6d7-1981-47d9-8550-d321f2123926 None admin] PATH_INFO: `/v3/groups/30c4a95995f64e39acec036fd8aa814c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:36.392929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52b6d7-1981-47d9-8550-d321f2123926 None admin] RBAC: Authorizing `identity:get_group(group_id=30c4a95995f64e39acec036fd8aa814c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:36.394375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52b6d7-1981-47d9-8550-d321f2123926 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:36.396049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 232/453] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 10:07:36 2022] GET /identity/v3/groups/30c4a95995f64e39acec036fd8aa814c => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:36.397707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:36.402130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52b6d7-1981-47d9-8550-d321f2123926 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:36.433203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:36.446478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb062f6-dd3e-43a8-a3d9-ba1e83c651d0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:36.482850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f2b74-eb1d-4f53-9565-ebfebac4d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:36.483508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f2b74-eb1d-4f53-9565-ebfebac4d442 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:36.483812 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f2b74-eb1d-4f53-9565-ebfebac4d442 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:36.484083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f2b74-eb1d-4f53-9565-ebfebac4d442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:36.484943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f2b74-eb1d-4f53-9565-ebfebac4d442 None admin] RBAC: Adding query filter params (group.id=43f1e96af8c24c6e9d473f63e5bccd86, role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=5250969aacd849649f4438fde7d1550d) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:36.485240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f2b74-eb1d-4f53-9565-ebfebac4d442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:36.486714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f2b74-eb1d-4f53-9565-ebfebac4d442 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:36.492761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 222/454] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 10:07:36 2022] GET /identity/v3/role_assignments?group.id=43f1e96af8c24c6e9d473f63e5bccd86&scope.project.id=5250969aacd849649f4438fde7d1550d&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:36.517455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52b6d7-1981-47d9-8550-d321f2123926 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:36.559464 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43731eb-5b72-41e1-a262-efb133d7627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:36.560195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43731eb-5b72-41e1-a262-efb133d7627f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:36.560484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43731eb-5b72-41e1-a262-efb133d7627f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:36.560765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43731eb-5b72-41e1-a262-efb133d7627f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:36.561615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43731eb-5b72-41e1-a262-efb133d7627f None admin] RBAC: Adding query filter params (group.id=30c4a95995f64e39acec036fd8aa814c, role.id=26c081183cd3490c977d961b36b9cee4, scope.project.id=89fcb966a1644945aee124d621ce16dd) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:36.561928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43731eb-5b72-41e1-a262-efb133d7627f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:36.563433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43731eb-5b72-41e1-a262-efb133d7627f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:36.570637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 233/455] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 10:07:36 2022] GET /identity/v3/role_assignments?group.id=30c4a95995f64e39acec036fd8aa814c&scope.project.id=89fcb966a1644945aee124d621ce16dd&role.id=26c081183cd3490c977d961b36b9cee4 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:39.101237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8461d8-92fa-4d65-86b3-e7a517097bb0 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:39.101740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8461d8-92fa-4d65-86b3-e7a517097bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:39.101740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8461d8-92fa-4d65-86b3-e7a517097bb0 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:39.103486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 223/456] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:39.120545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a357fd-4e0d-4254-86ec-dce1771dcb70 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:39.121499 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a357fd-4e0d-4254-86ec-dce1771dcb70 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:39.121973 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a357fd-4e0d-4254-86ec-dce1771dcb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:39.148216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-00a357fd-4e0d-4254-86ec-dce1771dcb70 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:39.149745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-00a357fd-4e0d-4254-86ec-dce1771dcb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:39.241220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 234/457] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:39.289402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8461d8-92fa-4d65-86b3-e7a517097bb0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:39.420288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8461d8-92fa-4d65-86b3-e7a517097bb0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:39.439826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363cd33-ac5d-4e7d-b884-0ff6688f3a94 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:39.440661 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363cd33-ac5d-4e7d-b884-0ff6688f3a94 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:39.441046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363cd33-ac5d-4e7d-b884-0ff6688f3a94 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:39.443125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 235/458] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:39.443674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:39.451435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966acae-3501-4cd5-91fb-6640fabc8af4 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:39.451900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966acae-3501-4cd5-91fb-6640fabc8af4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:39.452654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966acae-3501-4cd5-91fb-6640fabc8af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:39.471851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf1afe-cdf8-46c2-855b-0a553607593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:39.473208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf1afe-cdf8-46c2-855b-0a553607593b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:39.473716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf1afe-cdf8-46c2-855b-0a553607593b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:39.474321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf1afe-cdf8-46c2-855b-0a553607593b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:39.490814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b966acae-3501-4cd5-91fb-6640fabc8af4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:39.492164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b966acae-3501-4cd5-91fb-6640fabc8af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:39.494203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf1afe-cdf8-46c2-855b-0a553607593b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:39.502532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf1afe-cdf8-46c2-855b-0a553607593b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:39.536168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1aaf1afe-cdf8-46c2-855b-0a553607593b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:39.536534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:39.537563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:39.538449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:39.538449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:39.538449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:39.538449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:39.539778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 224/459] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:39.547600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf1afe-cdf8-46c2-855b-0a553607593b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:39.643306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 236/460] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:39.676058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966acae-3501-4cd5-91fb-6640fabc8af4 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:39.787974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf1afe-cdf8-46c2-855b-0a553607593b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:39.794150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966acae-3501-4cd5-91fb-6640fabc8af4 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:39.833447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f992be-d162-466a-aff6-79cc895d5289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:39.834568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f992be-d162-466a-aff6-79cc895d5289 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:39.835025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f992be-d162-466a-aff6-79cc895d5289 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:39.835455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f992be-d162-466a-aff6-79cc895d5289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:39.847500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f992be-d162-466a-aff6-79cc895d5289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:39.849249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f992be-d162-466a-aff6-79cc895d5289 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:39.858889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade53377-fc4e-43e3-889b-49c858702d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:39.859816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade53377-fc4e-43e3-889b-49c858702d0f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:39.860244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade53377-fc4e-43e3-889b-49c858702d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:39.860672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade53377-fc4e-43e3-889b-49c858702d0f None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:39.861553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade53377-fc4e-43e3-889b-49c858702d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:39.862001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade53377-fc4e-43e3-889b-49c858702d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:39.863570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade53377-fc4e-43e3-889b-49c858702d0f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-37f992be-d162-466a-aff6-79cc895d5289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:39.868289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:39.869343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:39.870339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:39.870339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:39.870339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:39.870339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:39.870339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 237/461] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:39.871274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533fbf2-f1f9-4b4f-9b31-976c4894a769 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:39.871580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533fbf2-f1f9-4b4f-9b31-976c4894a769 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:39.871881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533fbf2-f1f9-4b4f-9b31-976c4894a769 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:39.873567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 238/462] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:39.878238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533fbf2-f1f9-4b4f-9b31-976c4894a769 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:39.880188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 225/463] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:39.881619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff47c4-df39-4775-b619-7dfdb65f4982 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:39.882053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff47c4-df39-4775-b619-7dfdb65f4982 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:39.882473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff47c4-df39-4775-b619-7dfdb65f4982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:39.891279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:39.900034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-86ff47c4-df39-4775-b619-7dfdb65f4982 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:39.901509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-86ff47c4-df39-4775-b619-7dfdb65f4982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:39.926695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:39.972898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 226/464] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:39.973979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff47c4-df39-4775-b619-7dfdb65f4982 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:39.998807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533fbf2-f1f9-4b4f-9b31-976c4894a769 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:40.051200 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f620-1f1b-49d4-94fc-c8ebbe1d363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:40.051879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f620-1f1b-49d4-94fc-c8ebbe1d363d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.052354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f620-1f1b-49d4-94fc-c8ebbe1d363d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.052777 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f620-1f1b-49d4-94fc-c8ebbe1d363d None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.053657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386f620-1f1b-49d4-94fc-c8ebbe1d363d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:40.054128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386f620-1f1b-49d4-94fc-c8ebbe1d363d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:40.055974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386f620-1f1b-49d4-94fc-c8ebbe1d363d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:40.070104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 239/465] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:40.071284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f620-1f1b-49d4-94fc-c8ebbe1d363d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:40.097744 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff47c4-df39-4775-b619-7dfdb65f4982 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:40.138157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5701603-68c0-453b-9539-95fdaf2c242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:40.139578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5701603-68c0-453b-9539-95fdaf2c242b None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.140002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5701603-68c0-453b-9539-95fdaf2c242b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.140415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5701603-68c0-453b-9539-95fdaf2c242b None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.141317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5701603-68c0-453b-9539-95fdaf2c242b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:40.143039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5701603-68c0-453b-9539-95fdaf2c242b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:40.156188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:40.168199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 227/466] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:07:39 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:07:40.169542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5701603-68c0-453b-9539-95fdaf2c242b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:40.192857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:40.194479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f620-1f1b-49d4-94fc-c8ebbe1d363d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:40.245126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1682b-1d26-45da-aa63-921fa9438e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:40.246193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1682b-1d26-45da-aa63-921fa9438e63 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.246560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1682b-1d26-45da-aa63-921fa9438e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.246929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1682b-1d26-45da-aa63-921fa9438e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.261799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1682b-1d26-45da-aa63-921fa9438e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:40.263516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1682b-1d26-45da-aa63-921fa9438e63 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-70c1682b-1d26-45da-aa63-921fa9438e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:40.287218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:40.288176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:40.289061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:40.289061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:40.289061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:40.289061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:40.289061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 240/467] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:40.290180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30f06-13c9-4c22-9fd7-357ac62ba601 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.290287 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30f06-13c9-4c22-9fd7-357ac62ba601 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.290537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30f06-13c9-4c22-9fd7-357ac62ba601 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.292182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 241/468] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:40.304110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce07bc-73e0-474b-a263-07ab9e16f273 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.304466 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce07bc-73e0-474b-a263-07ab9e16f273 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.304650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce07bc-73e0-474b-a263-07ab9e16f273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.326600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e8ce07bc-73e0-474b-a263-07ab9e16f273 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:40.328191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e8ce07bc-73e0-474b-a263-07ab9e16f273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:40.334436 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5701603-68c0-453b-9539-95fdaf2c242b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:40.383902 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384cac6-c7c1-4e0b-9b34-eb583407c887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:40.384604 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384cac6-c7c1-4e0b-9b34-eb583407c887 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.384891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384cac6-c7c1-4e0b-9b34-eb583407c887 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.385164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384cac6-c7c1-4e0b-9b34-eb583407c887 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.385904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384cac6-c7c1-4e0b-9b34-eb583407c887 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:40.387430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384cac6-c7c1-4e0b-9b34-eb583407c887 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:40.414589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 228/469] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:07:40 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:07:40.416629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384cac6-c7c1-4e0b-9b34-eb583407c887 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:40.422889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 242/470] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:40.448946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce07bc-73e0-474b-a263-07ab9e16f273 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:40.516293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:40.525546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:40.583054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384cac6-c7c1-4e0b-9b34-eb583407c887 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:40.584502 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce07bc-73e0-474b-a263-07ab9e16f273 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:40.626046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841009-ae72-4b8a-ad09-c35c288f03b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:40.627142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841009-ae72-4b8a-ad09-c35c288f03b1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.627430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841009-ae72-4b8a-ad09-c35c288f03b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.627763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841009-ae72-4b8a-ad09-c35c288f03b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.628464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841009-ae72-4b8a-ad09-c35c288f03b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:40.628777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841009-ae72-4b8a-ad09-c35c288f03b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:40.630212 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841009-ae72-4b8a-ad09-c35c288f03b1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:40.631090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c20a6c-6acf-4212-946f-a6162b2b950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:40.631925 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c20a6c-6acf-4212-946f-a6162b2b950c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.632204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c20a6c-6acf-4212-946f-a6162b2b950c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.632541 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c20a6c-6acf-4212-946f-a6162b2b950c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.644836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 229/471] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:40.647737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80dc3-9fde-4b39-80ef-a14abff449bb None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.647737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80dc3-9fde-4b39-80ef-a14abff449bb None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.647737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80dc3-9fde-4b39-80ef-a14abff449bb None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.647737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 230/472] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:40.652461 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c20a6c-6acf-4212-946f-a6162b2b950c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:40.652693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e80dc3-9fde-4b39-80ef-a14abff449bb None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:40.654077 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c20a6c-6acf-4212-946f-a6162b2b950c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-a8c20a6c-6acf-4212-946f-a6162b2b950c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:40.676280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:40.677289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:40.678168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:40.678168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:40.678168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:40.678168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:40.678168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 243/473] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:40.679320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28df1e1-c25f-4fa4-8b16-f68ece215655 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.679606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28df1e1-c25f-4fa4-8b16-f68ece215655 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.679885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28df1e1-c25f-4fa4-8b16-f68ece215655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.697709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b28df1e1-c25f-4fa4-8b16-f68ece215655 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:40.699102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b28df1e1-c25f-4fa4-8b16-f68ece215655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:40.794559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e80dc3-9fde-4b39-80ef-a14abff449bb None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:40.798620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 244/474] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:40.799663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28df1e1-c25f-4fa4-8b16-f68ece215655 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:40.837521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:40.846530 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cbc55-1d68-4603-8ba6-fbebd041accf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:40.847354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cbc55-1d68-4603-8ba6-fbebd041accf None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:40.847804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cbc55-1d68-4603-8ba6-fbebd041accf None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:40.848146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cbc55-1d68-4603-8ba6-fbebd041accf None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:40.848958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cbc55-1d68-4603-8ba6-fbebd041accf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:40.850627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cbc55-1d68-4603-8ba6-fbebd041accf None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:40.854224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:40.883928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 231/475] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:07:40 2022] POST /identity/v3/users => generated 248 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:07:40.884896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cbc55-1d68-4603-8ba6-fbebd041accf None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:41.089508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28df1e1-c25f-4fa4-8b16-f68ece215655 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:41.127027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cbc55-1d68-4603-8ba6-fbebd041accf None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:41.175238 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae94617-a245-4485-b068-dee9a327b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:41.177180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94617-a245-4485-b068-dee9a327b207 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:41.177637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94617-a245-4485-b068-dee9a327b207 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:41.178055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94617-a245-4485-b068-dee9a327b207 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:41.179504 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae94617-a245-4485-b068-dee9a327b207 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:41.181117 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae94617-a245-4485-b068-dee9a327b207 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:41.190795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.sql.core [None req-7ae94617-a245-4485-b068-dee9a327b207 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 10:07:41.190795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 10:07:41.190795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [parameters: {'id': '3cba754c9fca42bda2a1b4b36164532c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 10:07:41.190795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80159) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 10:07:41.199990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485ecdc-420f-4d30-99d2-100f877ff103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:41.201388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485ecdc-420f-4d30-99d2-100f877ff103 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:41.201873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485ecdc-420f-4d30-99d2-100f877ff103 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:41.202346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485ecdc-420f-4d30-99d2-100f877ff103 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:41.203655 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485ecdc-420f-4d30-99d2-100f877ff103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:41.204252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485ecdc-420f-4d30-99d2-100f877ff103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:41.206026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485ecdc-420f-4d30-99d2-100f877ff103 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7ae94617-a245-4485-b068-dee9a327b207 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application result.read() Jun 22 10:07:41.211940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return ref.to_dict() Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:07:41.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application yield resource Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise self.value Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application session.commit() Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 10:07:41.213947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.session.flush() Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application compat.raise_( Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 10:07:41.216230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:07:41.217392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application result.read() Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:07:41.218517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [parameters: {'id': '3cba754c9fca42bda2a1b4b36164532c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:41.223567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 10:07:41.226536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:41.228733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 232/476] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Jun 22 10:07:40 2022] POST /identity/v3/roles => generated 144 bytes in 329 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:41.228733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae94617-a245-4485-b068-dee9a327b207 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:41.253297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 245/477] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:41.255226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485ecdc-420f-4d30-99d2-100f877ff103 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:41.324028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:41.473353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:41.492457 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485ecdc-420f-4d30-99d2-100f877ff103 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:41.528766 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae94617-a245-4485-b068-dee9a327b207 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:41.531169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b8bf9-0e00-4613-92cf-5615ba83989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:41.532049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b8bf9-0e00-4613-92cf-5615ba83989e None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:41.533866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b8bf9-0e00-4613-92cf-5615ba83989e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:41.534351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b8bf9-0e00-4613-92cf-5615ba83989e None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:41.535273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b8bf9-0e00-4613-92cf-5615ba83989e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:41.536968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b8bf9-0e00-4613-92cf-5615ba83989e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:41.566789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 246/478] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:07:41 2022] POST /identity/v3/users => generated 249 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:07:41.588709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560b45c-7ffb-47c0-ae42-f5ba8d32c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:41.590014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560b45c-7ffb-47c0-ae42-f5ba8d32c54e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:41.590533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560b45c-7ffb-47c0-ae42-f5ba8d32c54e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:41.591070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560b45c-7ffb-47c0-ae42-f5ba8d32c54e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:41.604608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560b45c-7ffb-47c0-ae42-f5ba8d32c54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-e560b45c-7ffb-47c0-ae42-f5ba8d32c54e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:41.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:41.615747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:07:41.616569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:41.619641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 233/479] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:07:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:41.627696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b8bf9-0e00-4613-92cf-5615ba83989e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:41.744307 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b8bf9-0e00-4613-92cf-5615ba83989e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:41.782592 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64435631-9c61-4b5d-906a-eac1085a355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:41.784035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435631-9c61-4b5d-906a-eac1085a355c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:41.784519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435631-9c61-4b5d-906a-eac1085a355c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:41.784992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435631-9c61-4b5d-906a-eac1085a355c None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:41.785961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64435631-9c61-4b5d-906a-eac1085a355c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:41.786523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64435631-9c61-4b5d-906a-eac1085a355c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:41.788147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64435631-9c61-4b5d-906a-eac1085a355c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:41.798176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 247/480] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:42.719219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5284-fb85-46f6-b504-bdf5c86491e3 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:42.719769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5284-fb85-46f6-b504-bdf5c86491e3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:42.719858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5284-fb85-46f6-b504-bdf5c86491e3 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:42.721444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 234/481] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:42.727146 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac27ff-8c10-4419-b493-362a86ba65da None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:42.727559 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac27ff-8c10-4419-b493-362a86ba65da None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:42.727742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac27ff-8c10-4419-b493-362a86ba65da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:42.752368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-2cac27ff-8c10-4419-b493-362a86ba65da None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:42.753652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2cac27ff-8c10-4419-b493-362a86ba65da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:42.755933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:42.855159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 248/482] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:42.893545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb5284-fb85-46f6-b504-bdf5c86491e3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:42.951944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac244d00-a32d-4d33-b394-d0515574a6ed None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:42.952274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac244d00-a32d-4d33-b394-d0515574a6ed None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:42.952510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac244d00-a32d-4d33-b394-d0515574a6ed None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:42.954142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 249/483] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:42.959938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c828e1-109a-473f-8f74-3b8ec19d7b07 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:42.960245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c828e1-109a-473f-8f74-3b8ec19d7b07 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:42.960537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c828e1-109a-473f-8f74-3b8ec19d7b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:42.988588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c3c828e1-109a-473f-8f74-3b8ec19d7b07 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:42.993273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c3c828e1-109a-473f-8f74-3b8ec19d7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:43.056447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb5284-fb85-46f6-b504-bdf5c86491e3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:43.084465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:43.114699 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 250/484] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:43.137976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302d01b-a696-4c99-bee4-aa53eea19091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:43.138782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302d01b-a696-4c99-bee4-aa53eea19091 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:43.139073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302d01b-a696-4c99-bee4-aa53eea19091 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:43.139352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302d01b-a696-4c99-bee4-aa53eea19091 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:43.156193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302d01b-a696-4c99-bee4-aa53eea19091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3302d01b-a696-4c99-bee4-aa53eea19091 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:43.166976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:43.167969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:43.169404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 235/485] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:43.171528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c828e1-109a-473f-8f74-3b8ec19d7b07 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:43.178011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302d01b-a696-4c99-bee4-aa53eea19091 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:43.245329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:43.285529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c828e1-109a-473f-8f74-3b8ec19d7b07 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:43.328349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536208a-6031-4729-8dda-6be9719b2ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:43.329196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536208a-6031-4729-8dda-6be9719b2ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:43.329487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536208a-6031-4729-8dda-6be9719b2ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:43.329759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536208a-6031-4729-8dda-6be9719b2ad5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:43.349056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536208a-6031-4729-8dda-6be9719b2ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-c536208a-6031-4729-8dda-6be9719b2ad5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:43.357470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:43.358403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:43.359238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:43.364921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 251/486] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:43.365996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536208a-6031-4729-8dda-6be9719b2ad5 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:43.384736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302d01b-a696-4c99-bee4-aa53eea19091 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:43.422334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d225ca7-b2b1-4759-9132-60a7349c9479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:43.423003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d225ca7-b2b1-4759-9132-60a7349c9479 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:43.423290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d225ca7-b2b1-4759-9132-60a7349c9479 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:43.423566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d225ca7-b2b1-4759-9132-60a7349c9479 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:43.424400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d225ca7-b2b1-4759-9132-60a7349c9479 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:43.424712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d225ca7-b2b1-4759-9132-60a7349c9479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:43.426109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d225ca7-b2b1-4759-9132-60a7349c9479 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:43.435954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 236/487] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:43.447674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d225ca7-b2b1-4759-9132-60a7349c9479 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:43.493331 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:43.517027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536208a-6031-4729-8dda-6be9719b2ad5 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:43.557241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:43.583741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f558ae-a34c-4f70-a6fb-6c62c9ad2229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:43.584874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f558ae-a34c-4f70-a6fb-6c62c9ad2229 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:43.584874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f558ae-a34c-4f70-a6fb-6c62c9ad2229 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:43.585134 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f558ae-a34c-4f70-a6fb-6c62c9ad2229 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:43.585900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f558ae-a34c-4f70-a6fb-6c62c9ad2229 None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:43.586209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f558ae-a34c-4f70-a6fb-6c62c9ad2229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:43.587682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f558ae-a34c-4f70-a6fb-6c62c9ad2229 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:43.604209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d225ca7-b2b1-4759-9132-60a7349c9479 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:43.609013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 252/488] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:43.613993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c437e-a74e-4bcb-acdc-dc0657c1b2f2 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:43.614290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c437e-a74e-4bcb-acdc-dc0657c1b2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:43.614603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c437e-a74e-4bcb-acdc-dc0657c1b2f2 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:43.615987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 253/489] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:07:43.616694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c437e-a74e-4bcb-acdc-dc0657c1b2f2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:43.652503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eabcdd-2931-43eb-bf48-5c0b3998ceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:43.653698 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eabcdd-2931-43eb-bf48-5c0b3998ceda None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:43.654116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eabcdd-2931-43eb-bf48-5c0b3998ceda None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:43.654553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eabcdd-2931-43eb-bf48-5c0b3998ceda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:43.666763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eabcdd-2931-43eb-bf48-5c0b3998ceda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:43.668502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eabcdd-2931-43eb-bf48-5c0b3998ceda None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-f6eabcdd-2931-43eb-bf48-5c0b3998ceda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:43.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:43.688464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:43.689415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:43.689415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:43.689415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:43.689415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:43.692035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 237/490] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:43.693696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211b88-b39b-4c1a-b7be-899f40fe8029 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:43.694174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211b88-b39b-4c1a-b7be-899f40fe8029 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:43.694637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211b88-b39b-4c1a-b7be-899f40fe8029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:43.716219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ce211b88-b39b-4c1a-b7be-899f40fe8029 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:43.718068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ce211b88-b39b-4c1a-b7be-899f40fe8029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:43.737541 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c437e-a74e-4bcb-acdc-dc0657c1b2f2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:43.778547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6ead-4826-402f-9d5f-a80c30de34db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:43.779962 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6ead-4826-402f-9d5f-a80c30de34db None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:43.780250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6ead-4826-402f-9d5f-a80c30de34db None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:43.780521 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6ead-4826-402f-9d5f-a80c30de34db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:43.793148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f6ead-4826-402f-9d5f-a80c30de34db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:43.794736 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f6ead-4826-402f-9d5f-a80c30de34db None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:43.801787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 238/491] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:43.803428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce211b88-b39b-4c1a-b7be-899f40fe8029 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:43.819942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-002f6ead-4826-402f-9d5f-a80c30de34db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:43.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:43.828139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:43.829605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:43.829605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:43.829605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:43.829605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:43.829605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 254/492] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:43.834281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6ead-4826-402f-9d5f-a80c30de34db None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:43.886888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:43.918153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce211b88-b39b-4c1a-b7be-899f40fe8029 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:43.945587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6ead-4826-402f-9d5f-a80c30de34db None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:43.956088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d1f1e-1c14-4967-8a3b-74967a4d4168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:43.957153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1f1e-1c14-4967-8a3b-74967a4d4168 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:43.957627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1f1e-1c14-4967-8a3b-74967a4d4168 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:43.958092 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1f1e-1c14-4967-8a3b-74967a4d4168 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:43.959215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d1f1e-1c14-4967-8a3b-74967a4d4168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:43.959713 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d1f1e-1c14-4967-8a3b-74967a4d4168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:43.961356 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d1f1e-1c14-4967-8a3b-74967a4d4168 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:43.974419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 239/493] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:43.975765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d1f1e-1c14-4967-8a3b-74967a4d4168 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:43.985997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bafde-0c38-46ef-beb3-879d5f34743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:43.986739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bafde-0c38-46ef-beb3-879d5f34743b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:43.987026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bafde-0c38-46ef-beb3-879d5f34743b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:43.987304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bafde-0c38-46ef-beb3-879d5f34743b None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:43.988296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bafde-0c38-46ef-beb3-879d5f34743b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:43.988417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bafde-0c38-46ef-beb3-879d5f34743b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:43.989767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bafde-0c38-46ef-beb3-879d5f34743b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:44.002829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 255/494] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:44.003542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bafde-0c38-46ef-beb3-879d5f34743b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:44.061400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:44.101307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d1f1e-1c14-4967-8a3b-74967a4d4168 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:44.128337 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bafde-0c38-46ef-beb3-879d5f34743b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:44.130177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:44.139504 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97547d10-ee5e-40ca-a168-414fcc1ed85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:44.140741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547d10-ee5e-40ca-a168-414fcc1ed85a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.141233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547d10-ee5e-40ca-a168-414fcc1ed85a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.141723 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547d10-ee5e-40ca-a168-414fcc1ed85a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.153726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97547d10-ee5e-40ca-a168-414fcc1ed85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-97547d10-ee5e-40ca-a168-414fcc1ed85a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:44.166298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:44.167818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 240/495] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:44.169979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97547d10-ee5e-40ca-a168-414fcc1ed85a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:44.181532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb30bbc-3c05-44d9-8103-d4ed1b69a3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:44.182686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb30bbc-3c05-44d9-8103-d4ed1b69a3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.183130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb30bbc-3c05-44d9-8103-d4ed1b69a3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.183442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb30bbc-3c05-44d9-8103-d4ed1b69a3e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.194330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb30bbc-3c05-44d9-8103-d4ed1b69a3e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:44.196155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb30bbc-3c05-44d9-8103-d4ed1b69a3e0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-5fb30bbc-3c05-44d9-8103-d4ed1b69a3e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:44.217636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:44.218856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 256/496] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 10:07:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:44.220490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb30bbc-3c05-44d9-8103-d4ed1b69a3e0 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:44.294085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97547d10-ee5e-40ca-a168-414fcc1ed85a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:44.330419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad154d49-ab2e-4aa6-9f69-175d4fe1c76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:44.331555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154d49-ab2e-4aa6-9f69-175d4fe1c76d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.331838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154d49-ab2e-4aa6-9f69-175d4fe1c76d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.332112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154d49-ab2e-4aa6-9f69-175d4fe1c76d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.335058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:44.338991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb30bbc-3c05-44d9-8103-d4ed1b69a3e0 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:44.345658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad154d49-ab2e-4aa6-9f69-175d4fe1c76d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:44.345949 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad154d49-ab2e-4aa6-9f69-175d4fe1c76d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-ad154d49-ab2e-4aa6-9f69-175d4fe1c76d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:44.367206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:44.368205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:44.369126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:44.369126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:44.369126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:44.369126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:44.369126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:44.369126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:44.369126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:44.369126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:44.369126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:07:44.369126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:44.369643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 241/497] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:44.370245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad154d49-ab2e-4aa6-9f69-175d4fe1c76d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:44.383679 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332890e-3f87-45bd-8938-92c1b465a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:44.384784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332890e-3f87-45bd-8938-92c1b465a805 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.385323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332890e-3f87-45bd-8938-92c1b465a805 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.385831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332890e-3f87-45bd-8938-92c1b465a805 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.387491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332890e-3f87-45bd-8938-92c1b465a805 None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:44.388066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332890e-3f87-45bd-8938-92c1b465a805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:44.390378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332890e-3f87-45bd-8938-92c1b465a805 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:44.399902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 257/498] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:44.402049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca844bf-285e-4b8a-9fb0-50adfa3aeb17 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.402806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca844bf-285e-4b8a-9fb0-50adfa3aeb17 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.403298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca844bf-285e-4b8a-9fb0-50adfa3aeb17 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.405588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 258/499] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:44.406776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca844bf-285e-4b8a-9fb0-50adfa3aeb17 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:44.442943 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:44.499879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad154d49-ab2e-4aa6-9f69-175d4fe1c76d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:44.537517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e317643-325f-4e6e-9316-72d7e890ad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:44.538255 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e317643-325f-4e6e-9316-72d7e890ad88 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.538571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e317643-325f-4e6e-9316-72d7e890ad88 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.538848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e317643-325f-4e6e-9316-72d7e890ad88 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.539738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e317643-325f-4e6e-9316-72d7e890ad88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:44.540049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e317643-325f-4e6e-9316-72d7e890ad88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:44.541542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e317643-325f-4e6e-9316-72d7e890ad88 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:44.545467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca844bf-285e-4b8a-9fb0-50adfa3aeb17 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:44.579675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 242/500] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 10:07:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:44.580564 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e317643-325f-4e6e-9316-72d7e890ad88 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:44.580839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bfe74-b224-4669-883d-80c3eb2829a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:44.581529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bfe74-b224-4669-883d-80c3eb2829a6 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.581800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bfe74-b224-4669-883d-80c3eb2829a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.582074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bfe74-b224-4669-883d-80c3eb2829a6 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.582986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bfe74-b224-4669-883d-80c3eb2829a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:44.583297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bfe74-b224-4669-883d-80c3eb2829a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:44.584748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bfe74-b224-4669-883d-80c3eb2829a6 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:44.632230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 259/501] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 10:07:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:44.633569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76f86-8257-4ffe-beb4-3bdea0b9de1d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.633858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76f86-8257-4ffe-beb4-3bdea0b9de1d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.634105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76f86-8257-4ffe-beb4-3bdea0b9de1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.653220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:44.653446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0db76f86-8257-4ffe-beb4-3bdea0b9de1d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:44.654692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0db76f86-8257-4ffe-beb4-3bdea0b9de1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:44.705950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e317643-325f-4e6e-9316-72d7e890ad88 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:44.734104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 260/502] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:44.735625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e995-7533-442e-9900-7cbfb248d3ce None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.735913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e995-7533-442e-9900-7cbfb248d3ce None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.736192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e995-7533-442e-9900-7cbfb248d3ce None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.737648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 261/503] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:44.738240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e995-7533-442e-9900-7cbfb248d3ce None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:44.755565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b9ce3-ad7c-4e31-98ef-7299c7e5d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:44.756305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9ce3-ad7c-4e31-98ef-7299c7e5d632 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.756590 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9ce3-ad7c-4e31-98ef-7299c7e5d632 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.756950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9ce3-ad7c-4e31-98ef-7299c7e5d632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.757987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:44.769225 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b9ce3-ad7c-4e31-98ef-7299c7e5d632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:44.770755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b9ce3-ad7c-4e31-98ef-7299c7e5d632 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d49b9ce3-ad7c-4e31-98ef-7299c7e5d632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:44.796614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:44.797596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:44.799176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:44.799176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:44.799176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:44.799176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:44.799176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 243/504] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:44.799176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b9ce3-ad7c-4e31-98ef-7299c7e5d632 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:44.866052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e995-7533-442e-9900-7cbfb248d3ce None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:44.906305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219e792-cbcf-4617-bcab-d42af2d9c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:44.907009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219e792-cbcf-4617-bcab-d42af2d9c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.907303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219e792-cbcf-4617-bcab-d42af2d9c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.907551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219e792-cbcf-4617-bcab-d42af2d9c9b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.911433 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b9ce3-ad7c-4e31-98ef-7299c7e5d632 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:44.913934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:44.946865 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abaecd-1219-468c-bd7d-de5e38cb4ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:44.947541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abaecd-1219-468c-bd7d-de5e38cb4ede None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.947824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abaecd-1219-468c-bd7d-de5e38cb4ede None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.948097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abaecd-1219-468c-bd7d-de5e38cb4ede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.985355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219e792-cbcf-4617-bcab-d42af2d9c9b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:44.986903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219e792-cbcf-4617-bcab-d42af2d9c9b5 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:45.001508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:45.024808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abaecd-1219-468c-bd7d-de5e38cb4ede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:45.026196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abaecd-1219-468c-bd7d-de5e38cb4ede None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:45.096432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 262/505] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:45.097731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b574-4aa7-49fb-b783-b79c27b9fdf4 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:45.098027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b574-4aa7-49fb-b783-b79c27b9fdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:45.098305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b574-4aa7-49fb-b783-b79c27b9fdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:45.115831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9020b574-4aa7-49fb-b783-b79c27b9fdf4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:45.117075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9020b574-4aa7-49fb-b783-b79c27b9fdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:45.138529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 244/506] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:45.138529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abaecd-1219-468c-bd7d-de5e38cb4ede None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.140278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:45.201661 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 263/507] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:45.202674 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020b574-4aa7-49fb-b783-b79c27b9fdf4 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.251115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:45.274437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abaecd-1219-468c-bd7d-de5e38cb4ede None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:45.310984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2939-ad8d-4c1f-8270-9e6195c4b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:45.311710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2939-ad8d-4c1f-8270-9e6195c4b3bc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:45.312009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2939-ad8d-4c1f-8270-9e6195c4b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:45.312275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2939-ad8d-4c1f-8270-9e6195c4b3bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:45.315766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020b574-4aa7-49fb-b783-b79c27b9fdf4 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:45.324198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de2939-ad8d-4c1f-8270-9e6195c4b3bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-39de2939-ad8d-4c1f-8270-9e6195c4b3bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:45.333595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:45.334614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:45.335444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 245/508] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:45.336114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2939-ad8d-4c1f-8270-9e6195c4b3bc None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.362272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33291106-fb80-41f5-af17-022a11dacac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:45.363125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291106-fb80-41f5-af17-022a11dacac8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:45.363271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291106-fb80-41f5-af17-022a11dacac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:45.363569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291106-fb80-41f5-af17-022a11dacac8 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:45.364320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33291106-fb80-41f5-af17-022a11dacac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:45.364596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33291106-fb80-41f5-af17-022a11dacac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:45.366020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33291106-fb80-41f5-af17-022a11dacac8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:45.377817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 264/509] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:45.378683 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33291106-fb80-41f5-af17-022a11dacac8 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.406141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:45.452260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2939-ad8d-4c1f-8270-9e6195c4b3bc None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:45.488091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33291106-fb80-41f5-af17-022a11dacac8 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:45.489105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa9edc-c30a-4ee4-9d7c-07ad0a88c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:45.489723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:45.489973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa9edc-c30a-4ee4-9d7c-07ad0a88c6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:45.490814 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa9edc-c30a-4ee4-9d7c-07ad0a88c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:45.491202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa9edc-c30a-4ee4-9d7c-07ad0a88c6f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:45.502981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa9edc-c30a-4ee4-9d7c-07ad0a88c6f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:45.504463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa9edc-c30a-4ee4-9d7c-07ad0a88c6f6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7daa9edc-c30a-4ee4-9d7c-07ad0a88c6f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:45.522883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:45.524019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:45.524935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:45.524935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:45.524935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:45.524935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:45.525365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 246/510] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:45.526088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa9edc-c30a-4ee4-9d7c-07ad0a88c6f6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.529848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c320d2-f87f-4d0a-95dd-55f512381561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:45.530726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c320d2-f87f-4d0a-95dd-55f512381561 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:45.531011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c320d2-f87f-4d0a-95dd-55f512381561 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:45.531286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c320d2-f87f-4d0a-95dd-55f512381561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:45.544469 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c320d2-f87f-4d0a-95dd-55f512381561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:45.546101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c320d2-f87f-4d0a-95dd-55f512381561 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-e8c320d2-f87f-4d0a-95dd-55f512381561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:45.564268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:45.565178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:45.566036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:45.566036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:45.566036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:45.566036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:45.566036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 265/511] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:45.566335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c320d2-f87f-4d0a-95dd-55f512381561 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.633539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa9edc-c30a-4ee4-9d7c-07ad0a88c6f6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:45.651268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:45.670923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac1ff0-2721-4db6-8c7c-77a0d58e6a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:45.671730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac1ff0-2721-4db6-8c7c-77a0d58e6a6e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:45.672014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac1ff0-2721-4db6-8c7c-77a0d58e6a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:45.672287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac1ff0-2721-4db6-8c7c-77a0d58e6a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:45.672787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c320d2-f87f-4d0a-95dd-55f512381561 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:45.684288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac1ff0-2721-4db6-8c7c-77a0d58e6a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:45.686208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac1ff0-2721-4db6-8c7c-77a0d58e6a6e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-9eac1ff0-2721-4db6-8c7c-77a0d58e6a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:45.703228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:45.704320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:45.705396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:45.705396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:45.705396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:45.705396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:45.705396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 247/512] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:45.705396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac1ff0-2721-4db6-8c7c-77a0d58e6a6e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.709930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267338b-b844-4442-a48f-feb5d4c4b986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:45.710709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267338b-b844-4442-a48f-feb5d4c4b986 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:45.710997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267338b-b844-4442-a48f-feb5d4c4b986 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:45.711277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267338b-b844-4442-a48f-feb5d4c4b986 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:45.712093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267338b-b844-4442-a48f-feb5d4c4b986 None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:45.712405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267338b-b844-4442-a48f-feb5d4c4b986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:45.713973 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267338b-b844-4442-a48f-feb5d4c4b986 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:45.723174 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 266/513] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:45.724015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267338b-b844-4442-a48f-feb5d4c4b986 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.743265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:45.811010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac1ff0-2721-4db6-8c7c-77a0d58e6a6e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:45.827569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267338b-b844-4442-a48f-feb5d4c4b986 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:45.845483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ffad-a73b-4825-b3c3-dba92d67cff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:45.846290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ffad-a73b-4825-b3c3-dba92d67cff8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:45.846599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ffad-a73b-4825-b3c3-dba92d67cff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:45.846866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ffad-a73b-4825-b3c3-dba92d67cff8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:45.855322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8ffad-a73b-4825-b3c3-dba92d67cff8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:45.856817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8ffad-a73b-4825-b3c3-dba92d67cff8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:45.862733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea880c9-c6b3-4350-9dcd-13fc19907ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:45.863420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea880c9-c6b3-4350-9dcd-13fc19907ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:45.863715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea880c9-c6b3-4350-9dcd-13fc19907ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:45.863995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea880c9-c6b3-4350-9dcd-13fc19907ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:45.864736 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea880c9-c6b3-4350-9dcd-13fc19907ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:45.865046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea880c9-c6b3-4350-9dcd-13fc19907ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:45.866460 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea880c9-c6b3-4350-9dcd-13fc19907ff0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5da8ffad-a73b-4825-b3c3-dba92d67cff8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:45.871950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:45.873133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:45.874274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 248/514] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:45.875370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ffad-a73b-4825-b3c3-dba92d67cff8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.879781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 267/515] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:45.880647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea880c9-c6b3-4350-9dcd-13fc19907ff0 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.910644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:45.959223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:45.983824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ffad-a73b-4825-b3c3-dba92d67cff8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:45.985151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea880c9-c6b3-4350-9dcd-13fc19907ff0 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:46.019196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc87299-3838-46ff-abb9-2bf31ef6ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.019864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f5d58-0625-4086-aa63-921ebd6d393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.020163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87299-3838-46ff-abb9-2bf31ef6ab14 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.020430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87299-3838-46ff-abb9-2bf31ef6ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.020526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f5d58-0625-4086-aa63-921ebd6d393f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.020706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87299-3838-46ff-abb9-2bf31ef6ab14 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.020802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f5d58-0625-4086-aa63-921ebd6d393f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.021065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f5d58-0625-4086-aa63-921ebd6d393f None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.021479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc87299-3838-46ff-abb9-2bf31ef6ab14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:46.021789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc87299-3838-46ff-abb9-2bf31ef6ab14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.021876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f5d58-0625-4086-aa63-921ebd6d393f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:46.022095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f5d58-0625-4086-aa63-921ebd6d393f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.023321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc87299-3838-46ff-abb9-2bf31ef6ab14 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.023533 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f5d58-0625-4086-aa63-921ebd6d393f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.036342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 268/516] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:46.041284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 249/517] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:46.041426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f5d58-0625-4086-aa63-921ebd6d393f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.041543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc87299-3838-46ff-abb9-2bf31ef6ab14 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.130379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:46.144165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc87299-3838-46ff-abb9-2bf31ef6ab14 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:46.146720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f5d58-0625-4086-aa63-921ebd6d393f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:46.179250 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670cb8-ba38-493e-b4d0-474f01aedcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.179924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670cb8-ba38-493e-b4d0-474f01aedcdc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.180205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670cb8-ba38-493e-b4d0-474f01aedcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.180479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670cb8-ba38-493e-b4d0-474f01aedcdc None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.181040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd39c1-5658-4961-885e-9ad90aede081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.181341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670cb8-ba38-493e-b4d0-474f01aedcdc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:46.181658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670cb8-ba38-493e-b4d0-474f01aedcdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.181789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd39c1-5658-4961-885e-9ad90aede081 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.182097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd39c1-5658-4961-885e-9ad90aede081 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.182355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd39c1-5658-4961-885e-9ad90aede081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.183176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670cb8-ba38-493e-b4d0-474f01aedcdc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.185396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:46.195493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd39c1-5658-4961-885e-9ad90aede081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.197045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd39c1-5658-4961-885e-9ad90aede081 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.201934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 250/518] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 10:07:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:46.202630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670cb8-ba38-493e-b4d0-474f01aedcdc None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-55dd39c1-5658-4961-885e-9ad90aede081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:46.217692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:46.218727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:46.219607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:46.219607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:46.219607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:46.219607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:46.220331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 269/519] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:46.221271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd39c1-5658-4961-885e-9ad90aede081 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.304269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670cb8-ba38-493e-b4d0-474f01aedcdc None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:46.323169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd39c1-5658-4961-885e-9ad90aede081 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:46.339111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0415f1-c15f-4699-92c4-e9d12214682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.339916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0415f1-c15f-4699-92c4-e9d12214682b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.340190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0415f1-c15f-4699-92c4-e9d12214682b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.340478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0415f1-c15f-4699-92c4-e9d12214682b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.347688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0415f1-c15f-4699-92c4-e9d12214682b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.349153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0415f1-c15f-4699-92c4-e9d12214682b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.357214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03506514-ee73-48e4-b71f-e9cb208a8975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.357888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506514-ee73-48e4-b71f-e9cb208a8975 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.358171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506514-ee73-48e4-b71f-e9cb208a8975 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.358448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506514-ee73-48e4-b71f-e9cb208a8975 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.359183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03506514-ee73-48e4-b71f-e9cb208a8975 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.360622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03506514-ee73-48e4-b71f-e9cb208a8975 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-ae0415f1-c15f-4699-92c4-e9d12214682b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:46.363468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:46.364374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:46.365232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:46.365232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:46.365232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:46.365232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:46.365232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:46.365232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:46.365232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:46.365232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:46.365232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 251/520] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:46.365700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0415f1-c15f-4699-92c4-e9d12214682b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.380177 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:46.380526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 270/521] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:07:46 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:07:46.381244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03506514-ee73-48e4-b71f-e9cb208a8975 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.440114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:46.505141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0415f1-c15f-4699-92c4-e9d12214682b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:46.505360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03506514-ee73-48e4-b71f-e9cb208a8975 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:46.541924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b230d-a1c1-4a64-9aee-8fa8fa632452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.542755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b230d-a1c1-4a64-9aee-8fa8fa632452 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.542989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226cb4-dcb7-4797-9e5b-37d1c4686810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.543103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b230d-a1c1-4a64-9aee-8fa8fa632452 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.543296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b230d-a1c1-4a64-9aee-8fa8fa632452 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.543648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226cb4-dcb7-4797-9e5b-37d1c4686810 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.543955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226cb4-dcb7-4797-9e5b-37d1c4686810 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.544232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226cb4-dcb7-4797-9e5b-37d1c4686810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.551240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b230d-a1c1-4a64-9aee-8fa8fa632452 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.554059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b230d-a1c1-4a64-9aee-8fa8fa632452 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-341b230d-a1c1-4a64-9aee-8fa8fa632452 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:46.569407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:46.570449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:46.571618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:46.571618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:46.571618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:46.571618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:46.571618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:46.571618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:46.571618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:46.571618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:46.571618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 252/522] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:46.572096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b230d-a1c1-4a64-9aee-8fa8fa632452 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.640324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd226cb4-dcb7-4797-9e5b-37d1c4686810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.642445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd226cb4-dcb7-4797-9e5b-37d1c4686810 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.651511 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:46.693634 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:46.693830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b230d-a1c1-4a64-9aee-8fa8fa632452 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:46.733493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082df0d-5d13-4639-9f59-4b5a03710b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.734155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082df0d-5d13-4639-9f59-4b5a03710b1c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.734439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082df0d-5d13-4639-9f59-4b5a03710b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.734760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082df0d-5d13-4639-9f59-4b5a03710b1c None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.735508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082df0d-5d13-4639-9f59-4b5a03710b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:46.735804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082df0d-5d13-4639-9f59-4b5a03710b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.737228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082df0d-5d13-4639-9f59-4b5a03710b1c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.749159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 253/523] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:46.750113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082df0d-5d13-4639-9f59-4b5a03710b1c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.760420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 271/524] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:46.763425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226cb4-dcb7-4797-9e5b-37d1c4686810 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.859820 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082df0d-5d13-4639-9f59-4b5a03710b1c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:46.872309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226cb4-dcb7-4797-9e5b-37d1c4686810 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:46.887367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:46.898876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e5f9-37d8-44f6-aee4-54014f12f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.899554 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e5f9-37d8-44f6-aee4-54014f12f318 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.899912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e5f9-37d8-44f6-aee4-54014f12f318 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.900278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e5f9-37d8-44f6-aee4-54014f12f318 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.901082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842e5f9-37d8-44f6-aee4-54014f12f318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:46.901402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842e5f9-37d8-44f6-aee4-54014f12f318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.902883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842e5f9-37d8-44f6-aee4-54014f12f318 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.914081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e03cf9-02ea-4645-8a8e-092b8a2f5a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:46.914947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e03cf9-02ea-4645-8a8e-092b8a2f5a02 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:46.915057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e03cf9-02ea-4645-8a8e-092b8a2f5a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:46.915298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e03cf9-02ea-4645-8a8e-092b8a2f5a02 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:46.916121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e03cf9-02ea-4645-8a8e-092b8a2f5a02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:46.916430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e03cf9-02ea-4645-8a8e-092b8a2f5a02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:46.917888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e03cf9-02ea-4645-8a8e-092b8a2f5a02 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:46.922466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 254/525] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:46.922466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e5f9-37d8-44f6-aee4-54014f12f318 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.943308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 272/526] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:46.943308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e03cf9-02ea-4645-8a8e-092b8a2f5a02 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:46.948433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:47.029267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e5f9-37d8-44f6-aee4-54014f12f318 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:47.058075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e03cf9-02ea-4645-8a8e-092b8a2f5a02 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:47.066059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7a144-285c-4d8a-b6c9-f813b8d40b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:47.066915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7a144-285c-4d8a-b6c9-f813b8d40b50 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:47.067199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7a144-285c-4d8a-b6c9-f813b8d40b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:47.067475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7a144-285c-4d8a-b6c9-f813b8d40b50 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:47.074879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7a144-285c-4d8a-b6c9-f813b8d40b50 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:47.076479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7a144-285c-4d8a-b6c9-f813b8d40b50 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-85d7a144-285c-4d8a-b6c9-f813b8d40b50 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:47.091364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:47.092387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:47.093291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 255/527] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:47.094001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7a144-285c-4d8a-b6c9-f813b8d40b50 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:47.103519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9951-c010-4cd5-b706-708f8dc61bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:47.104365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9951-c010-4cd5-b706-708f8dc61bcf None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:47.104651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9951-c010-4cd5-b706-708f8dc61bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:47.104913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9951-c010-4cd5-b706-708f8dc61bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:47.121474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb9951-c010-4cd5-b706-708f8dc61bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:47.123845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb9951-c010-4cd5-b706-708f8dc61bcf None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:47.141900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-35bb9951-c010-4cd5-b706-708f8dc61bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:47.146693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:47.147594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:47.148452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:47.148452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:47.148452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:47.148452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:47.150715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 273/528] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:47.151810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9951-c010-4cd5-b706-708f8dc61bcf None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:47.203352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7a144-285c-4d8a-b6c9-f813b8d40b50 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:47.213390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:47.248811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42478d-14eb-464d-a151-ed39b839a9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:47.249482 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42478d-14eb-464d-a151-ed39b839a9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:47.249763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42478d-14eb-464d-a151-ed39b839a9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:47.250032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42478d-14eb-464d-a151-ed39b839a9d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:47.250921 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42478d-14eb-464d-a151-ed39b839a9d2 None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=f91c2e9ae8844d9181aff785c02cf3be) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:47.251225 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42478d-14eb-464d-a151-ed39b839a9d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:47.252688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42478d-14eb-464d-a151-ed39b839a9d2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:47.270537 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 256/529] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:47 2022] GET /identity/v3/role_assignments?user.id=f91c2e9ae8844d9181aff785c02cf3be&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:47.270537 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42478d-14eb-464d-a151-ed39b839a9d2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:47.277419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9951-c010-4cd5-b706-708f8dc61bcf None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:47.317278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf53b6-0a6d-4592-8e9a-9a79e115d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:47.318078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf53b6-0a6d-4592-8e9a-9a79e115d53e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:47.318439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf53b6-0a6d-4592-8e9a-9a79e115d53e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:47.318830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf53b6-0a6d-4592-8e9a-9a79e115d53e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:47.319770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf53b6-0a6d-4592-8e9a-9a79e115d53e None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=e0055a33a380435d83a6d7384417c10f) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:47.320193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf53b6-0a6d-4592-8e9a-9a79e115d53e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:47.322079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf53b6-0a6d-4592-8e9a-9a79e115d53e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:47.329713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 274/530] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:47 2022] GET /identity/v3/role_assignments?user.id=e0055a33a380435d83a6d7384417c10f&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:47.330602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf53b6-0a6d-4592-8e9a-9a79e115d53e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:47.404387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42478d-14eb-464d-a151-ed39b839a9d2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:47.418729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:47.451054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de7f24-e468-468a-8e8a-4a8f84c4851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:47.451830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de7f24-e468-468a-8e8a-4a8f84c4851b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:47.452118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de7f24-e468-468a-8e8a-4a8f84c4851b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:47.452402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de7f24-e468-468a-8e8a-4a8f84c4851b None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:47.453286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de7f24-e468-468a-8e8a-4a8f84c4851b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:47.453663 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de7f24-e468-468a-8e8a-4a8f84c4851b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:47.455230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de7f24-e468-468a-8e8a-4a8f84c4851b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:47.485838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 257/531] 10.222.0.66 () {56 vars in 1139 bytes} [Wed Jun 22 10:07:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:47.490683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de7f24-e468-468a-8e8a-4a8f84c4851b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:47.571465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf53b6-0a6d-4592-8e9a-9a79e115d53e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:47.601194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:47.628514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db3f9-676f-422f-9ba5-3944879bbb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:47.630713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db3f9-676f-422f-9ba5-3944879bbb03 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:47.631205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db3f9-676f-422f-9ba5-3944879bbb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:47.632437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db3f9-676f-422f-9ba5-3944879bbb03 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:47.633385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41db3f9-676f-422f-9ba5-3944879bbb03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:47.634678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41db3f9-676f-422f-9ba5-3944879bbb03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:47.639668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41db3f9-676f-422f-9ba5-3944879bbb03 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:47.644336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de7f24-e468-468a-8e8a-4a8f84c4851b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:47.667001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 275/532] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:47.675542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db3f9-676f-422f-9ba5-3944879bbb03 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:47.704461 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72530d63-c28d-46d8-b7b0-7649a232fa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:47.705472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72530d63-c28d-46d8-b7b0-7649a232fa82 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:47.707346 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72530d63-c28d-46d8-b7b0-7649a232fa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:47.707862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72530d63-c28d-46d8-b7b0-7649a232fa82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:47.778178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:47.846869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72530d63-c28d-46d8-b7b0-7649a232fa82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:47.851850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72530d63-c28d-46d8-b7b0-7649a232fa82 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:47.876101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db3f9-676f-422f-9ba5-3944879bbb03 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:47.939332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6676-2dab-4ca2-abe5-940e3724b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:47.940561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6676-2dab-4ca2-abe5-940e3724b91d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:47.941049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6676-2dab-4ca2-abe5-940e3724b91d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:47.941539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6676-2dab-4ca2-abe5-940e3724b91d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:47.949526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6676-2dab-4ca2-abe5-940e3724b91d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:47.958529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6676-2dab-4ca2-abe5-940e3724b91d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-c88b6676-2dab-4ca2-abe5-940e3724b91d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:47.982899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:47.983848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:47.984727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:47.984727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:47.984727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:47.984727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:47.984727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:47.984727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:47.984727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:47.984727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:47.987283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 276/533] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:47.990550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 258/534] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:47.992513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6676-2dab-4ca2-abe5-940e3724b91d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:47.997141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72530d63-c28d-46d8-b7b0-7649a232fa82 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:48.091934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:48.109924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:48.184539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72530d63-c28d-46d8-b7b0-7649a232fa82 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:48.192840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6676-2dab-4ca2-abe5-940e3724b91d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:48.230088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bddb6b-f346-48d2-beb3-c7b5f04b8b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:48.230848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bddb6b-f346-48d2-beb3-c7b5f04b8b88 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:48.231139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bddb6b-f346-48d2-beb3-c7b5f04b8b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:48.231620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bddb6b-f346-48d2-beb3-c7b5f04b8b88 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:48.232439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bddb6b-f346-48d2-beb3-c7b5f04b8b88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:48.232779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bddb6b-f346-48d2-beb3-c7b5f04b8b88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:48.234292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bddb6b-f346-48d2-beb3-c7b5f04b8b88 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:48.248483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 277/535] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:48.254056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bddb6b-f346-48d2-beb3-c7b5f04b8b88 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:48.299825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efdda8-3bc8-4137-92f5-5156a27cc035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:48.300640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdda8-3bc8-4137-92f5-5156a27cc035 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:48.300923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdda8-3bc8-4137-92f5-5156a27cc035 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:48.301200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdda8-3bc8-4137-92f5-5156a27cc035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:48.325318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efdda8-3bc8-4137-92f5-5156a27cc035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:48.326827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efdda8-3bc8-4137-92f5-5156a27cc035 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-80efdda8-3bc8-4137-92f5-5156a27cc035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:48.357647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:48.358612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:48.359471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:48.359471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:48.359471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:48.359471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:48.363539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bddb6b-f346-48d2-beb3-c7b5f04b8b88 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:48.371326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 259/536] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:48.375003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:48.379477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efdda8-3bc8-4137-92f5-5156a27cc035 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:48.400351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498cecd-39c4-43d3-8ba6-28abf604e033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:48.401028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498cecd-39c4-43d3-8ba6-28abf604e033 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:48.401344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498cecd-39c4-43d3-8ba6-28abf604e033 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:48.401649 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498cecd-39c4-43d3-8ba6-28abf604e033 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:48.402513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498cecd-39c4-43d3-8ba6-28abf604e033 None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=3748ece05182480f90a70dc587f2a007) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:48.402842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498cecd-39c4-43d3-8ba6-28abf604e033 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:48.404384 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498cecd-39c4-43d3-8ba6-28abf604e033 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:48.411441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 278/537] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:48 2022] GET /identity/v3/role_assignments?user.id=3748ece05182480f90a70dc587f2a007&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:48.505208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b4b4-52cc-4b36-9693-443faa01042d None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:48.505829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b4b4-52cc-4b36-9693-443faa01042d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:48.506324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b4b4-52cc-4b36-9693-443faa01042d None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:48.509236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 279/538] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:07:48.511148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efdda8-3bc8-4137-92f5-5156a27cc035 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:48.514139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762fe9a-b19b-40db-991c-1eaf96fa3b23 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:48.514746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762fe9a-b19b-40db-991c-1eaf96fa3b23 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:48.515322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762fe9a-b19b-40db-991c-1eaf96fa3b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:48.540493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e762fe9a-b19b-40db-991c-1eaf96fa3b23 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:48.541777 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e762fe9a-b19b-40db-991c-1eaf96fa3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:48.550918 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:48.585112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a529d2a-6b69-4e8a-8bcd-68c0fccf9894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:48.585827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a529d2a-6b69-4e8a-8bcd-68c0fccf9894 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:48.586112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a529d2a-6b69-4e8a-8bcd-68c0fccf9894 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:48.586419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a529d2a-6b69-4e8a-8bcd-68c0fccf9894 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:48.587236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a529d2a-6b69-4e8a-8bcd-68c0fccf9894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:48.587568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a529d2a-6b69-4e8a-8bcd-68c0fccf9894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:48.589076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a529d2a-6b69-4e8a-8bcd-68c0fccf9894 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:48.621857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 260/539] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:48.626648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a529d2a-6b69-4e8a-8bcd-68c0fccf9894 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:48.683364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 280/540] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:48.709726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762fe9a-b19b-40db-991c-1eaf96fa3b23 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:48.790065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a529d2a-6b69-4e8a-8bcd-68c0fccf9894 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:48.828281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c5276-1472-41ad-a227-3327a0ee2717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:48.829783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5276-1472-41ad-a227-3327a0ee2717 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:48.830218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5276-1472-41ad-a227-3327a0ee2717 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:48.830692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5276-1472-41ad-a227-3327a0ee2717 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:48.839269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c5276-1472-41ad-a227-3327a0ee2717 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:48.841484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c5276-1472-41ad-a227-3327a0ee2717 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1d2c5276-1472-41ad-a227-3327a0ee2717 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:48.860442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:48.861398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:48.862300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:48.862300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:48.862300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:48.862300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:48.862300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:48.862300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:48.862300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:48.862300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:48.865276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 261/541] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:48.872998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c5276-1472-41ad-a227-3327a0ee2717 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:48.918994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:48.958869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:48.969425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762fe9a-b19b-40db-991c-1eaf96fa3b23 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:49.016618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22efedc-0a89-49e9-bd72-3945a6e443e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:49.017435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22efedc-0a89-49e9-bd72-3945a6e443e2 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:49.017727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22efedc-0a89-49e9-bd72-3945a6e443e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:49.018005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22efedc-0a89-49e9-bd72-3945a6e443e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:49.029269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22efedc-0a89-49e9-bd72-3945a6e443e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:49.037516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c5276-1472-41ad-a227-3327a0ee2717 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-d22efedc-0a89-49e9-bd72-3945a6e443e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:49.042632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:49.043558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:49.044518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:49.046251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 281/542] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:49.047728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22efedc-0a89-49e9-bd72-3945a6e443e2 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:49.101644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c8ea-eda2-42c9-9db6-6bd9472ae91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:49.102406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c8ea-eda2-42c9-9db6-6bd9472ae91a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:49.103370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c8ea-eda2-42c9-9db6-6bd9472ae91a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:49.103652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c8ea-eda2-42c9-9db6-6bd9472ae91a None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:49.104683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3c8ea-eda2-42c9-9db6-6bd9472ae91a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:49.106234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3c8ea-eda2-42c9-9db6-6bd9472ae91a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:49.107855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3c8ea-eda2-42c9-9db6-6bd9472ae91a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:49.134765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 262/543] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:49.136582 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c8ea-eda2-42c9-9db6-6bd9472ae91a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:49.217544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22efedc-0a89-49e9-bd72-3945a6e443e2 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:49.244585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:49.247379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c8ea-eda2-42c9-9db6-6bd9472ae91a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:49.275034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f47560-88ea-48a8-837d-408a1df1efb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:49.276131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f47560-88ea-48a8-837d-408a1df1efb1 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:49.276701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f47560-88ea-48a8-837d-408a1df1efb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:49.277233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f47560-88ea-48a8-837d-408a1df1efb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:49.278472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f47560-88ea-48a8-837d-408a1df1efb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:49.278970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f47560-88ea-48a8-837d-408a1df1efb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:49.280750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f47560-88ea-48a8-837d-408a1df1efb1 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:49.292876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cdef6-9e09-4440-85dd-4d3c9a5c1e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:49.293738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cdef6-9e09-4440-85dd-4d3c9a5c1e9d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:49.294083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cdef6-9e09-4440-85dd-4d3c9a5c1e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:49.294355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cdef6-9e09-4440-85dd-4d3c9a5c1e9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:49.295339 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cdef6-9e09-4440-85dd-4d3c9a5c1e9d None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=0afeafd76edb40289d715f81485fa7bc) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:49.295659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cdef6-9e09-4440-85dd-4d3c9a5c1e9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:49.297098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cdef6-9e09-4440-85dd-4d3c9a5c1e9d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:49.302087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 282/544] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:49.303724 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 263/545] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:49 2022] GET /identity/v3/role_assignments?user.id=0afeafd76edb40289d715f81485fa7bc&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:49.307894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f47560-88ea-48a8-837d-408a1df1efb1 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:49.351184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:49.452220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f47560-88ea-48a8-837d-408a1df1efb1 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:49.494532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101ef1c-e6b3-44a4-9226-992318216941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:49.495434 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101ef1c-e6b3-44a4-9226-992318216941 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:49.495717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101ef1c-e6b3-44a4-9226-992318216941 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:49.495989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101ef1c-e6b3-44a4-9226-992318216941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:49.511268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101ef1c-e6b3-44a4-9226-992318216941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:49.513272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101ef1c-e6b3-44a4-9226-992318216941 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-1101ef1c-e6b3-44a4-9226-992318216941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:49.538363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:49.539343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:49.540264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:49.540264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:49.540264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:49.540264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:49.542388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 283/546] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:49.548406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cdef6-9e09-4440-85dd-4d3c9a5c1e9d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:49.684322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cdef6-9e09-4440-85dd-4d3c9a5c1e9d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:49.728032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3c088-9301-4aaf-a26d-be5b24932454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:49.729471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c088-9301-4aaf-a26d-be5b24932454 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:49.730176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c088-9301-4aaf-a26d-be5b24932454 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:49.730874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c088-9301-4aaf-a26d-be5b24932454 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:49.732549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3c088-9301-4aaf-a26d-be5b24932454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:49.733309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3c088-9301-4aaf-a26d-be5b24932454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:49.736073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3c088-9301-4aaf-a26d-be5b24932454 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:49.762703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 264/547] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:49.767662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101ef1c-e6b3-44a4-9226-992318216941 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:49.880699 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab67ed-7fbf-4fe8-aade-4fbe481b656d None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:49.881013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab67ed-7fbf-4fe8-aade-4fbe481b656d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:49.881321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab67ed-7fbf-4fe8-aade-4fbe481b656d None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:49.882999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 265/548] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:07:49.888279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8685f3-2fa9-4b2d-8cfb-145bc3786353 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:49.888592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8685f3-2fa9-4b2d-8cfb-145bc3786353 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:49.888832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8685f3-2fa9-4b2d-8cfb-145bc3786353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:49.891917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:49.910450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-af8685f3-2fa9-4b2d-8cfb-145bc3786353 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:49.911851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-af8685f3-2fa9-4b2d-8cfb-145bc3786353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:49.931328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:49.931953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101ef1c-e6b3-44a4-9226-992318216941 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:49.968706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf364fa-fac0-41c8-9e96-2a0b32a38afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:49.969599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf364fa-fac0-41c8-9e96-2a0b32a38afd None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:49.969803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf364fa-fac0-41c8-9e96-2a0b32a38afd None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:49.970086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf364fa-fac0-41c8-9e96-2a0b32a38afd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:49.980017 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf364fa-fac0-41c8-9e96-2a0b32a38afd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:49.981636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf364fa-fac0-41c8-9e96-2a0b32a38afd None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:49.994640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 266/549] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:49.996107 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac0e27-a35e-42a0-aa74-fca544d58c5c None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:49.996395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac0e27-a35e-42a0-aa74-fca544d58c5c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:49.996667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac0e27-a35e-42a0-aa74-fca544d58c5c None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:50.002279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 267/550] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-ccf364fa-fac0-41c8-9e96-2a0b32a38afd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:50.003240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:50.004857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:50.006205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:50.006205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:50.006205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:50.006205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:50.006205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:50.006205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:50.006205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:50.006205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:50.006205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:07:50.006205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:50.007429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a850-21fe-4f11-96f8-ee7468b08ae1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:50.007850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a850-21fe-4f11-96f8-ee7468b08ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:50.008251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a850-21fe-4f11-96f8-ee7468b08ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:50.010887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 284/551] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:07:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:50.016778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf364fa-fac0-41c8-9e96-2a0b32a38afd None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:50.026834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ef31a850-21fe-4f11-96f8-ee7468b08ae1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:50.029294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ef31a850-21fe-4f11-96f8-ee7468b08ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:50.128574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 268/552] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:50.128574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31a850-21fe-4f11-96f8-ee7468b08ae1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:50.152013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf364fa-fac0-41c8-9e96-2a0b32a38afd None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:50.193651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:50.203895 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a86bc-dfdf-4776-b2ff-fce310887e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:50.204942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a86bc-dfdf-4776-b2ff-fce310887e01 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:50.205369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a86bc-dfdf-4776-b2ff-fce310887e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:50.205786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a86bc-dfdf-4776-b2ff-fce310887e01 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:50.206856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a86bc-dfdf-4776-b2ff-fce310887e01 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:50.207338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a86bc-dfdf-4776-b2ff-fce310887e01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:50.209014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a86bc-dfdf-4776-b2ff-fce310887e01 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:50.233686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 285/553] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 10:07:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:50.234884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a86bc-dfdf-4776-b2ff-fce310887e01 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:50.238001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:50.257411 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31a850-21fe-4f11-96f8-ee7468b08ae1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:50.296645 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b845e07-c00c-423b-b4c8-828c93a359ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:50.297204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845e07-c00c-423b-b4c8-828c93a359ee None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:50.297514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845e07-c00c-423b-b4c8-828c93a359ee None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:50.297791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845e07-c00c-423b-b4c8-828c93a359ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:50.309621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b845e07-c00c-423b-b4c8-828c93a359ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1b845e07-c00c-423b-b4c8-828c93a359ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:50.318106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:50.319409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 269/554] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:50.320384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b845e07-c00c-423b-b4c8-828c93a359ee None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:50.349046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a86bc-dfdf-4776-b2ff-fce310887e01 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:50.385850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09055330-9ac6-44a9-a5ff-1cdf300410c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:50.386967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09055330-9ac6-44a9-a5ff-1cdf300410c4 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:50.387394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09055330-9ac6-44a9-a5ff-1cdf300410c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:50.387847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09055330-9ac6-44a9-a5ff-1cdf300410c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:50.399288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09055330-9ac6-44a9-a5ff-1cdf300410c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-09055330-9ac6-44a9-a5ff-1cdf300410c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:50.407613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:50.409105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:50.410221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:50.412706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 286/555] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:50.413657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09055330-9ac6-44a9-a5ff-1cdf300410c4 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:50.430769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b845e07-c00c-423b-b4c8-828c93a359ee None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:50.463901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:50.468421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a190f-385f-4806-b031-94bdd22d4ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:50.469080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a190f-385f-4806-b031-94bdd22d4ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:50.469365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a190f-385f-4806-b031-94bdd22d4ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:50.469641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a190f-385f-4806-b031-94bdd22d4ae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:50.486527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:50.525082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09055330-9ac6-44a9-a5ff-1cdf300410c4 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:50.547566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a190f-385f-4806-b031-94bdd22d4ae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:50.549416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a190f-385f-4806-b031-94bdd22d4ae9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:50.562251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fa545-9f6c-483c-96a6-18f1e0d9f6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:50.563367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fa545-9f6c-483c-96a6-18f1e0d9f6be None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:50.563827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fa545-9f6c-483c-96a6-18f1e0d9f6be None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:50.564277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fa545-9f6c-483c-96a6-18f1e0d9f6be None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:50.565209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fa545-9f6c-483c-96a6-18f1e0d9f6be None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:50.565695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fa545-9f6c-483c-96a6-18f1e0d9f6be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:50.567326 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fa545-9f6c-483c-96a6-18f1e0d9f6be None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:50.577252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 287/556] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:50.578487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fa545-9f6c-483c-96a6-18f1e0d9f6be None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:50.661013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 270/557] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:50.661814 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a190f-385f-4806-b031-94bdd22d4ae9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:50.687450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fa545-9f6c-483c-96a6-18f1e0d9f6be None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:50.696972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:50.713567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:50.725271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c08be5-71d6-426d-9a20-4f5ffc9b570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:50.726311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c08be5-71d6-426d-9a20-4f5ffc9b570f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:50.726827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c08be5-71d6-426d-9a20-4f5ffc9b570f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:50.727304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c08be5-71d6-426d-9a20-4f5ffc9b570f None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:50.728253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c08be5-71d6-426d-9a20-4f5ffc9b570f None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:50.728743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c08be5-71d6-426d-9a20-4f5ffc9b570f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:50.730332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c08be5-71d6-426d-9a20-4f5ffc9b570f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:50.739979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 288/558] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:50.741258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c08be5-71d6-426d-9a20-4f5ffc9b570f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:50.777905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a190f-385f-4806-b031-94bdd22d4ae9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:50.817230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59ca25-2839-4d79-bba5-fb01d45bc0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:50.818062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ca25-2839-4d79-bba5-fb01d45bc0cf None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:50.818342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ca25-2839-4d79-bba5-fb01d45bc0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:50.818645 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ca25-2839-4d79-bba5-fb01d45bc0cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:50.830772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59ca25-2839-4d79-bba5-fb01d45bc0cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:50.832533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59ca25-2839-4d79-bba5-fb01d45bc0cf None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:50.848726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c08be5-71d6-426d-9a20-4f5ffc9b570f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0c59ca25-2839-4d79-bba5-fb01d45bc0cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:50.853086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:50.853959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:50.854922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:50.854922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:50.854922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:50.854922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:50.854922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 271/559] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:50.855614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59ca25-2839-4d79-bba5-fb01d45bc0cf None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:50.889010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cbfa7-b0e8-43f6-a8ae-163cd2ae7b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:50.890245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cbfa7-b0e8-43f6-a8ae-163cd2ae7b5e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:50.890796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cbfa7-b0e8-43f6-a8ae-163cd2ae7b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:50.891273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cbfa7-b0e8-43f6-a8ae-163cd2ae7b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:50.903256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cbfa7-b0e8-43f6-a8ae-163cd2ae7b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:50.905159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cbfa7-b0e8-43f6-a8ae-163cd2ae7b5e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-9b4cbfa7-b0e8-43f6-a8ae-163cd2ae7b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:50.924291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:50.925295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:50.926243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:50.926243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:50.926243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:50.926243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:50.928844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 289/560] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:50.929963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cbfa7-b0e8-43f6-a8ae-163cd2ae7b5e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:50.957556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:50.966900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:50.975139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59ca25-2839-4d79-bba5-fb01d45bc0cf None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.012473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70916b8-978a-4a12-92d2-3001d00e5fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.013341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70916b8-978a-4a12-92d2-3001d00e5fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.013621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70916b8-978a-4a12-92d2-3001d00e5fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.013922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70916b8-978a-4a12-92d2-3001d00e5fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.025038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70916b8-978a-4a12-92d2-3001d00e5fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.026600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70916b8-978a-4a12-92d2-3001d00e5fc5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.039569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cbfa7-b0e8-43f6-a8ae-163cd2ae7b5e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-e70916b8-978a-4a12-92d2-3001d00e5fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:51.046074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:51.047065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:51.048191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:51.048191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:51.048191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:51.048191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:51.052199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 272/561] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:51.053185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70916b8-978a-4a12-92d2-3001d00e5fc5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.080734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b396c81-3df1-4402-b2c5-02bb5661c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.081663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b396c81-3df1-4402-b2c5-02bb5661c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.082096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b396c81-3df1-4402-b2c5-02bb5661c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.082664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b396c81-3df1-4402-b2c5-02bb5661c6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.083708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b396c81-3df1-4402-b2c5-02bb5661c6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:51.084173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b396c81-3df1-4402-b2c5-02bb5661c6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.085834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b396c81-3df1-4402-b2c5-02bb5661c6d2 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.099279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 290/562] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:51.100805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087751-2365-49b9-8448-350437a51202 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.101235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087751-2365-49b9-8448-350437a51202 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.101682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087751-2365-49b9-8448-350437a51202 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.103340 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 291/563] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:51.104182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc087751-2365-49b9-8448-350437a51202 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.168126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70916b8-978a-4a12-92d2-3001d00e5fc5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.196027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:51.206968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e006a20-e582-4b2f-9417-82f4c86a2c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.207652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006a20-e582-4b2f-9417-82f4c86a2c5a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.207934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006a20-e582-4b2f-9417-82f4c86a2c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.208210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006a20-e582-4b2f-9417-82f4c86a2c5a None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.213239 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e006a20-e582-4b2f-9417-82f4c86a2c5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:51.213582 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e006a20-e582-4b2f-9417-82f4c86a2c5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.215077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e006a20-e582-4b2f-9417-82f4c86a2c5a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.223366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc087751-2365-49b9-8448-350437a51202 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.228905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 273/564] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:51.230049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e006a20-e582-4b2f-9417-82f4c86a2c5a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.245225 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:51.265462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d85b5-0274-4af4-ba21-315101688e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.266230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d85b5-0274-4af4-ba21-315101688e26 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.266592 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d85b5-0274-4af4-ba21-315101688e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.266904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d85b5-0274-4af4-ba21-315101688e26 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.267682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d85b5-0274-4af4-ba21-315101688e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:51.267996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d85b5-0274-4af4-ba21-315101688e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.269388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d85b5-0274-4af4-ba21-315101688e26 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.287254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 292/565] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:51.287254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc063-153a-41e5-a50c-f0e7f65500b8 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.287254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc063-153a-41e5-a50c-f0e7f65500b8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.287254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc063-153a-41e5-a50c-f0e7f65500b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.302059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-066dc063-153a-41e5-a50c-f0e7f65500b8 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:51.303296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-066dc063-153a-41e5-a50c-f0e7f65500b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:51.354673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e006a20-e582-4b2f-9417-82f4c86a2c5a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.382718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 293/566] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:51.382718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc063-153a-41e5-a50c-f0e7f65500b8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.396922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492478f-bf1d-4f89-a0f9-b99e0b911636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.397739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492478f-bf1d-4f89-a0f9-b99e0b911636 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.398022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492478f-bf1d-4f89-a0f9-b99e0b911636 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.398297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492478f-bf1d-4f89-a0f9-b99e0b911636 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.407183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492478f-bf1d-4f89-a0f9-b99e0b911636 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.408967 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492478f-bf1d-4f89-a0f9-b99e0b911636 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a492478f-bf1d-4f89-a0f9-b99e0b911636 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:51.423851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:51.425099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 274/567] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:51.426292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492478f-bf1d-4f89-a0f9-b99e0b911636 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.473637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:51.498938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:51.507212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc063-153a-41e5-a50c-f0e7f65500b8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.542217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492478f-bf1d-4f89-a0f9-b99e0b911636 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.545314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0d09b-3d0b-485e-a242-b7617942d61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.546116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0d09b-3d0b-485e-a242-b7617942d61a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.546395 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0d09b-3d0b-485e-a242-b7617942d61a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.546698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0d09b-3d0b-485e-a242-b7617942d61a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.553649 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0d09b-3d0b-485e-a242-b7617942d61a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.555124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0d09b-3d0b-485e-a242-b7617942d61a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-61b0d09b-3d0b-485e-a242-b7617942d61a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:51.568494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:51.569399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:51.570336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:51.570336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:51.570336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:51.570336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:51.570336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:51.570336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:51.570336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:51.570336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:51.570336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 294/568] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:51.570865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0d09b-3d0b-485e-a242-b7617942d61a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.580720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08203a94-68e0-4bd9-a951-41efea7c28b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.581523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08203a94-68e0-4bd9-a951-41efea7c28b3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.581804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08203a94-68e0-4bd9-a951-41efea7c28b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.582064 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08203a94-68e0-4bd9-a951-41efea7c28b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.590985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08203a94-68e0-4bd9-a951-41efea7c28b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.592461 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08203a94-68e0-4bd9-a951-41efea7c28b3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-08203a94-68e0-4bd9-a951-41efea7c28b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:51.606358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:51.607364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 275/569] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:51.608350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08203a94-68e0-4bd9-a951-41efea7c28b3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.687027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0d09b-3d0b-485e-a242-b7617942d61a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.713772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08203a94-68e0-4bd9-a951-41efea7c28b3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.719141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:51.724931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dc2fc-c41b-44b7-bd3e-bc5f08f10b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.725679 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dc2fc-c41b-44b7-bd3e-bc5f08f10b0b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.725965 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dc2fc-c41b-44b7-bd3e-bc5f08f10b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.726243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dc2fc-c41b-44b7-bd3e-bc5f08f10b0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.737117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dc2fc-c41b-44b7-bd3e-bc5f08f10b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:51.741641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-326dc2fc-c41b-44b7-bd3e-bc5f08f10b0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:51.745719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:51.746808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:51.747870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 295/570] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:51.749075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6bdf4-4cb4-4ddf-a6da-531ba9aad152 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.749360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6bdf4-4cb4-4ddf-a6da-531ba9aad152 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.749708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6bdf4-4cb4-4ddf-a6da-531ba9aad152 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.754544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00f08-ba0f-4438-80aa-7466ddb71489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.754755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 296/571] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:51.754861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00f08-ba0f-4438-80aa-7466ddb71489 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.754965 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6bdf4-4cb4-4ddf-a6da-531ba9aad152 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.755053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00f08-ba0f-4438-80aa-7466ddb71489 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.755053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00f08-ba0f-4438-80aa-7466ddb71489 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.755053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b00f08-ba0f-4438-80aa-7466ddb71489 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:51.755053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b00f08-ba0f-4438-80aa-7466ddb71489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.755351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b00f08-ba0f-4438-80aa-7466ddb71489 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.774191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 276/572] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:51.775122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00f08-ba0f-4438-80aa-7466ddb71489 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.860653 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6bdf4-4cb4-4ddf-a6da-531ba9aad152 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.875672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00f08-ba0f-4438-80aa-7466ddb71489 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.897374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981f103-310c-49ac-a569-2d0ac2913a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.898052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981f103-310c-49ac-a569-2d0ac2913a13 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.898364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981f103-310c-49ac-a569-2d0ac2913a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.898676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981f103-310c-49ac-a569-2d0ac2913a13 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.899478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981f103-310c-49ac-a569-2d0ac2913a13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:51.899795 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981f103-310c-49ac-a569-2d0ac2913a13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.901296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981f103-310c-49ac-a569-2d0ac2913a13 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.910792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c255b0-3815-4694-9c5e-a700953bc913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.911480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c255b0-3815-4694-9c5e-a700953bc913 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.911779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c255b0-3815-4694-9c5e-a700953bc913 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.912051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c255b0-3815-4694-9c5e-a700953bc913 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.912887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c255b0-3815-4694-9c5e-a700953bc913 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:51.913194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c255b0-3815-4694-9c5e-a700953bc913 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.914698 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c255b0-3815-4694-9c5e-a700953bc913 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.915697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 297/573] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:51.916617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981f103-310c-49ac-a569-2d0ac2913a13 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.932927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 277/574] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:51.934349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008362f-7f55-49e4-9317-8833754bdabe None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.934709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008362f-7f55-49e4-9317-8833754bdabe None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.934986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008362f-7f55-49e4-9317-8833754bdabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.963057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6008362f-7f55-49e4-9317-8833754bdabe None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:51.964313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6008362f-7f55-49e4-9317-8833754bdabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:51.975278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:52.008494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:52.027323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981f103-310c-49ac-a569-2d0ac2913a13 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.036033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 278/575] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:52.036971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008362f-7f55-49e4-9317-8833754bdabe None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.072671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c89159-24c0-4f1e-8bc7-0bacc775a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.073344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c89159-24c0-4f1e-8bc7-0bacc775a2ae None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.073639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c89159-24c0-4f1e-8bc7-0bacc775a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.073916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c89159-24c0-4f1e-8bc7-0bacc775a2ae None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.074704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c89159-24c0-4f1e-8bc7-0bacc775a2ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:52.075013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c89159-24c0-4f1e-8bc7-0bacc775a2ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:52.076446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c89159-24c0-4f1e-8bc7-0bacc775a2ae None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:52.084887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 298/576] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:52.085684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c89159-24c0-4f1e-8bc7-0bacc775a2ae None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.149390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008362f-7f55-49e4-9317-8833754bdabe None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.182364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5d088-f7f2-4e96-9288-284b9bec087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d088-f7f2-4e96-9288-284b9bec087c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.183454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c89159-24c0-4f1e-8bc7-0bacc775a2ae None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.183553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d088-f7f2-4e96-9288-284b9bec087c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.183834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d088-f7f2-4e96-9288-284b9bec087c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.194286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5d088-f7f2-4e96-9288-284b9bec087c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:52.195785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5d088-f7f2-4e96-9288-284b9bec087c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:52.196979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-aee5d088-f7f2-4e96-9288-284b9bec087c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:52.214856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:52.216012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:52.216957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:52.216957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:52.216957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:52.216957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:52.216957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 279/577] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:52.217230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5d088-f7f2-4e96-9288-284b9bec087c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.220385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a3d9-48aa-438b-8f96-cbf97813e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.221049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a3d9-48aa-438b-8f96-cbf97813e9af None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.221331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a3d9-48aa-438b-8f96-cbf97813e9af None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.221605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a3d9-48aa-438b-8f96-cbf97813e9af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.222467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83a3d9-48aa-438b-8f96-cbf97813e9af None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=b0c07436108d4a2089a74e7891b849c5) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:52.222817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83a3d9-48aa-438b-8f96-cbf97813e9af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:52.224296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83a3d9-48aa-438b-8f96-cbf97813e9af None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:52.230093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 299/578] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/role_assignments?user.id=b0c07436108d4a2089a74e7891b849c5&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:52.230845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a3d9-48aa-438b-8f96-cbf97813e9af None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.259029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:52.341125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5d088-f7f2-4e96-9288-284b9bec087c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.348576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a3d9-48aa-438b-8f96-cbf97813e9af None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.381358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41acecf-55f9-4c5c-a11b-5768b9d299ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.382176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41acecf-55f9-4c5c-a11b-5768b9d299ca None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.382462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41acecf-55f9-4c5c-a11b-5768b9d299ca None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.382770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41acecf-55f9-4c5c-a11b-5768b9d299ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.386739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7580c-1f63-42e5-813a-d597de8e2efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.387587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7580c-1f63-42e5-813a-d597de8e2efa None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.387880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7580c-1f63-42e5-813a-d597de8e2efa None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.388155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7580c-1f63-42e5-813a-d597de8e2efa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.395808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41acecf-55f9-4c5c-a11b-5768b9d299ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:52.397302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41acecf-55f9-4c5c-a11b-5768b9d299ca None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:52.399818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7580c-1f63-42e5-813a-d597de8e2efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-3ca7580c-1f63-42e5-813a-d597de8e2efa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:52.407717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:52.409037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:52.409902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 300/579] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:52.410663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7580c-1f63-42e5-813a-d597de8e2efa None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-c41acecf-55f9-4c5c-a11b-5768b9d299ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:52.419592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:52.420570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:52.421468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:52.421468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:52.421468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:52.421468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:52.425429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 280/580] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:52.426227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41acecf-55f9-4c5c-a11b-5768b9d299ca None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.455997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:52.505630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:52.522823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7580c-1f63-42e5-813a-d597de8e2efa None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.532498 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41acecf-55f9-4c5c-a11b-5768b9d299ca None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.559285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffcdd3-961c-4c06-ad82-9624489a8047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.560246 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffcdd3-961c-4c06-ad82-9624489a8047 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.560532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffcdd3-961c-4c06-ad82-9624489a8047 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.560809 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffcdd3-961c-4c06-ad82-9624489a8047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.572276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b159-4967-4c0e-a86e-a4bf19c4eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.572601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffcdd3-961c-4c06-ad82-9624489a8047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:52.573088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b159-4967-4c0e-a86e-a4bf19c4eb5a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.573433 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b159-4967-4c0e-a86e-a4bf19c4eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.573767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b159-4967-4c0e-a86e-a4bf19c4eb5a None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.574010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffcdd3-961c-4c06-ad82-9624489a8047 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:52.574658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b159-4967-4c0e-a86e-a4bf19c4eb5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:52.575208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b159-4967-4c0e-a86e-a4bf19c4eb5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:52.576641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b159-4967-4c0e-a86e-a4bf19c4eb5a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:52.592956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 281/581] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:52.592956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b159-4967-4c0e-a86e-a4bf19c4eb5a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-e9ffcdd3-961c-4c06-ad82-9624489a8047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:52.593250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:52.594206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:52.595359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:52.595359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:52.595359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:52.595359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:52.595359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 301/582] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:52.595359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffcdd3-961c-4c06-ad82-9624489a8047 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.706670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:52.713255 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b159-4967-4c0e-a86e-a4bf19c4eb5a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.716976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffcdd3-961c-4c06-ad82-9624489a8047 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.749745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13f8f5-4a0e-48a1-ab50-365845cb4889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.750450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13f8f5-4a0e-48a1-ab50-365845cb4889 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.750761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13f8f5-4a0e-48a1-ab50-365845cb4889 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.751040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13f8f5-4a0e-48a1-ab50-365845cb4889 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.751792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13f8f5-4a0e-48a1-ab50-365845cb4889 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:52.752107 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13f8f5-4a0e-48a1-ab50-365845cb4889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:52.752412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c1a68-101a-4a2e-a125-fd423922fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.753112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c1a68-101a-4a2e-a125-fd423922fd05 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.753394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c1a68-101a-4a2e-a125-fd423922fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.753486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13f8f5-4a0e-48a1-ab50-365845cb4889 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:52.753665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c1a68-101a-4a2e-a125-fd423922fd05 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.754426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c1a68-101a-4a2e-a125-fd423922fd05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:52.754810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c1a68-101a-4a2e-a125-fd423922fd05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:52.756310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c1a68-101a-4a2e-a125-fd423922fd05 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:52.759313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:52.767363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 282/583] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:52.767990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13f8f5-4a0e-48a1-ab50-365845cb4889 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.774572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 302/584] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:52.774572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c1a68-101a-4a2e-a125-fd423922fd05 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.878304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c1a68-101a-4a2e-a125-fd423922fd05 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.889100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13f8f5-4a0e-48a1-ab50-365845cb4889 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:52.917960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfd4b5-13a6-4c07-adcd-d9aaa9f6be2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.918669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfd4b5-13a6-4c07-adcd-d9aaa9f6be2a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.919030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfd4b5-13a6-4c07-adcd-d9aaa9f6be2a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.919301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfd4b5-13a6-4c07-adcd-d9aaa9f6be2a None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.920036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfd4b5-13a6-4c07-adcd-d9aaa9f6be2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:52.920329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfd4b5-13a6-4c07-adcd-d9aaa9f6be2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:52.921699 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfd4b5-13a6-4c07-adcd-d9aaa9f6be2a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:52.927554 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67aa12-c3f4-4e2d-b7c5-974bba8f6c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:52.928638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67aa12-c3f4-4e2d-b7c5-974bba8f6c12 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:52.929149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67aa12-c3f4-4e2d-b7c5-974bba8f6c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:52.929636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67aa12-c3f4-4e2d-b7c5-974bba8f6c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:52.933376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 303/585] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:52.934189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfd4b5-13a6-4c07-adcd-d9aaa9f6be2a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:52.937495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67aa12-c3f4-4e2d-b7c5-974bba8f6c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:52.939133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67aa12-c3f4-4e2d-b7c5-974bba8f6c12 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:52.950302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-df67aa12-c3f4-4e2d-b7c5-974bba8f6c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:52.953854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:52.954784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:52.955736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:52.955736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:52.955736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:52.955736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:52.955736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:52.955736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:52.955736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:52.955736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:52.955736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 283/586] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:52.956228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67aa12-c3f4-4e2d-b7c5-974bba8f6c12 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:53.019142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:53.050020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfd4b5-13a6-4c07-adcd-d9aaa9f6be2a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:53.062301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67aa12-c3f4-4e2d-b7c5-974bba8f6c12 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:53.085132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953c2c-cf97-4183-b240-ecc874c12cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:53.085927 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953c2c-cf97-4183-b240-ecc874c12cab None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:53.086212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953c2c-cf97-4183-b240-ecc874c12cab None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:53.086484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953c2c-cf97-4183-b240-ecc874c12cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:53.097874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7953c2c-cf97-4183-b240-ecc874c12cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:53.098724 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a38fdd-f34c-4422-a660-11368d063016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:53.099366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7953c2c-cf97-4183-b240-ecc874c12cab None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:53.099529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a38fdd-f34c-4422-a660-11368d063016 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:53.099810 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a38fdd-f34c-4422-a660-11368d063016 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:53.100089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a38fdd-f34c-4422-a660-11368d063016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:53.107496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a38fdd-f34c-4422-a660-11368d063016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:53.108980 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a38fdd-f34c-4422-a660-11368d063016 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-d7953c2c-cf97-4183-b240-ecc874c12cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:53.117380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:53.118488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:53.119419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:53.119419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:53.119419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:53.119419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:53.122656 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 304/587] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-94a38fdd-f34c-4422-a660-11368d063016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:53.123162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:53.124040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:53.125033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:53.125033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:53.125033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:53.125033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:53.125033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:53.125033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:53.125033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:53.125033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:53.125033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 284/588] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:53.125549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a38fdd-f34c-4422-a660-11368d063016 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:53.126736 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953c2c-cf97-4183-b240-ecc874c12cab None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:53.194066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:53.235507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a38fdd-f34c-4422-a660-11368d063016 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:53.242002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953c2c-cf97-4183-b240-ecc874c12cab None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:53.259082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:53.276516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6249d-993d-4b00-8e12-2eb22eba3516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:53.277126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6249d-993d-4b00-8e12-2eb22eba3516 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:53.277399 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6249d-993d-4b00-8e12-2eb22eba3516 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:53.277710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6249d-993d-4b00-8e12-2eb22eba3516 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:53.279892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6249d-993d-4b00-8e12-2eb22eba3516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:53.281740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6249d-993d-4b00-8e12-2eb22eba3516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:53.283008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6249d-993d-4b00-8e12-2eb22eba3516 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:53.290107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874a7ce-7e7a-451f-a95a-39d2a7d0314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:53.290960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874a7ce-7e7a-451f-a95a-39d2a7d0314b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:53.291243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874a7ce-7e7a-451f-a95a-39d2a7d0314b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:53.291524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874a7ce-7e7a-451f-a95a-39d2a7d0314b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:53.298126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 285/589] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:53.299467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6249d-993d-4b00-8e12-2eb22eba3516 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:53.300621 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874a7ce-7e7a-451f-a95a-39d2a7d0314b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:53.301998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874a7ce-7e7a-451f-a95a-39d2a7d0314b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-c874a7ce-7e7a-451f-a95a-39d2a7d0314b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:53.317346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:53.318478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:53.319491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 305/590] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:53.320102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874a7ce-7e7a-451f-a95a-39d2a7d0314b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:53.415439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6249d-993d-4b00-8e12-2eb22eba3516 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:53.431879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874a7ce-7e7a-451f-a95a-39d2a7d0314b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:53.451014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114806d-3748-4e20-a919-87f9e66d45c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:53.451745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114806d-3748-4e20-a919-87f9e66d45c8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:53.452056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114806d-3748-4e20-a919-87f9e66d45c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:53.452385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114806d-3748-4e20-a919-87f9e66d45c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:53.453118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114806d-3748-4e20-a919-87f9e66d45c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:53.453426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114806d-3748-4e20-a919-87f9e66d45c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:53.454816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114806d-3748-4e20-a919-87f9e66d45c8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:53.456464 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:53.469910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 286/591] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:53.470944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114806d-3748-4e20-a919-87f9e66d45c8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:53.473055 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081462-d63f-4844-b7a5-bda0ac439b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:53.473728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081462-d63f-4844-b7a5-bda0ac439b39 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:53.474011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081462-d63f-4844-b7a5-bda0ac439b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:53.474285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081462-d63f-4844-b7a5-bda0ac439b39 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:53.475126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081462-d63f-4844-b7a5-bda0ac439b39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:53.475433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081462-d63f-4844-b7a5-bda0ac439b39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:53.477039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081462-d63f-4844-b7a5-bda0ac439b39 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:53.494924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 306/592] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:53.494924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081462-d63f-4844-b7a5-bda0ac439b39 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:53.520634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:53.583134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114806d-3748-4e20-a919-87f9e66d45c8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:53.603992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081462-d63f-4844-b7a5-bda0ac439b39 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:53.623037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb2cd1-6834-4383-9c8e-63741c2cc361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:53.624069 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2cd1-6834-4383-9c8e-63741c2cc361 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:53.624343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2cd1-6834-4383-9c8e-63741c2cc361 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:53.624727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2cd1-6834-4383-9c8e-63741c2cc361 None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/e0055a33a380435d83a6d7384417c10f/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:53.643050 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb2cd1-6834-4383-9c8e-63741c2cc361 None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=e0055a33a380435d83a6d7384417c10f, role_id=111ab6c88aad4c2b96cc3d7ada1e2dc3)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:53.643610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb50f08-913f-49da-91c5-c7367bd45eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:53.644279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50f08-913f-49da-91c5-c7367bd45eef None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:53.644519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb2cd1-6834-4383-9c8e-63741c2cc361 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:53.644627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50f08-913f-49da-91c5-c7367bd45eef None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:53.644827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50f08-913f-49da-91c5-c7367bd45eef None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:53.645673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb50f08-913f-49da-91c5-c7367bd45eef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:53.645987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb50f08-913f-49da-91c5-c7367bd45eef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:53.647449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb50f08-913f-49da-91c5-c7367bd45eef None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:53.666551 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 287/593] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:07:53 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/e0055a33a380435d83a6d7384417c10f/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:53.666551 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb2cd1-6834-4383-9c8e-63741c2cc361 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:53.672529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 307/594] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 10:07:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:53.673599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb50f08-913f-49da-91c5-c7367bd45eef None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:53.724191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:53.791273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:53.801338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb50f08-913f-49da-91c5-c7367bd45eef None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:53.806493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb2cd1-6834-4383-9c8e-63741c2cc361 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:53.850277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ec57a-b74a-477a-85cf-96ea3effcd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:53.851149 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec57a-b74a-477a-85cf-96ea3effcd29 None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:53.851460 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec57a-b74a-477a-85cf-96ea3effcd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:53.851741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec57a-b74a-477a-85cf-96ea3effcd29 None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/f91c2e9ae8844d9181aff785c02cf3be/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:53.854486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdbb8f-f087-4623-92ba-f967e6de9ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:53.855435 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbb8f-f087-4623-92ba-f967e6de9ccb None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:53.855787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbb8f-f087-4623-92ba-f967e6de9ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:53.856127 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbb8f-f087-4623-92ba-f967e6de9ccb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:53.865387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdbb8f-f087-4623-92ba-f967e6de9ccb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:53.866875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdbb8f-f087-4623-92ba-f967e6de9ccb None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:53.869034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ec57a-b74a-477a-85cf-96ea3effcd29 None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=f91c2e9ae8844d9181aff785c02cf3be, role_id=111ab6c88aad4c2b96cc3d7ada1e2dc3)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:53.871124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ec57a-b74a-477a-85cf-96ea3effcd29 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8cbdbb8f-f087-4623-92ba-f967e6de9ccb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:53.882665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:53.883679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 288/595] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:53.885149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdbb8f-f087-4623-92ba-f967e6de9ccb None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:53.888043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 308/596] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:07:53 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/f91c2e9ae8844d9181aff785c02cf3be/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:53.895572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ec57a-b74a-477a-85cf-96ea3effcd29 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:54.081450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdbb8f-f087-4623-92ba-f967e6de9ccb None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:54.089285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:54.101494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ec57a-b74a-477a-85cf-96ea3effcd29 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:54.131113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c661d-fe51-4726-a565-2a4f7f5faf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:54.131919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c661d-fe51-4726-a565-2a4f7f5faf6b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.132193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c661d-fe51-4726-a565-2a4f7f5faf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.132458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c661d-fe51-4726-a565-2a4f7f5faf6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.149918 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c661d-fe51-4726-a565-2a4f7f5faf6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:54.151995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c661d-fe51-4726-a565-2a4f7f5faf6b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:54.152637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b8655-26f5-4e0f-a710-ca23b4810799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:54.153448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b8655-26f5-4e0f-a710-ca23b4810799 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.153729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b8655-26f5-4e0f-a710-ca23b4810799 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.154001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b8655-26f5-4e0f-a710-ca23b4810799 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.154886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b8655-26f5-4e0f-a710-ca23b4810799 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:54.155189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b8655-26f5-4e0f-a710-ca23b4810799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:54.157258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b8655-26f5-4e0f-a710-ca23b4810799 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3c2c661d-fe51-4726-a565-2a4f7f5faf6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:54.176741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:54.177693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:54.178632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:54.178632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:54.178632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:54.178632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:54.178857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 309/597] 10.222.0.66 () {56 vars in 1139 bytes} [Wed Jun 22 10:07:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:54.179912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 289/598] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:54.187596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b8655-26f5-4e0f-a710-ca23b4810799 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:54.188838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c661d-fe51-4726-a565-2a4f7f5faf6b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:54.191843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:54.300669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b8655-26f5-4e0f-a710-ca23b4810799 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:54.328575 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c661d-fe51-4726-a565-2a4f7f5faf6b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:54.337875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e3d6b-eb4d-41f8-a5c1-8c2f46335a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:54.338729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3d6b-eb4d-41f8-a5c1-8c2f46335a60 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.339016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3d6b-eb4d-41f8-a5c1-8c2f46335a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.339295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3d6b-eb4d-41f8-a5c1-8c2f46335a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.350915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e3d6b-eb4d-41f8-a5c1-8c2f46335a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:54.353107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e3d6b-eb4d-41f8-a5c1-8c2f46335a60 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:54.363751 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:54.369811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f4dd8-2e07-4db7-9cf8-2bcee3133210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:54.370935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4dd8-2e07-4db7-9cf8-2bcee3133210 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.371419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4dd8-2e07-4db7-9cf8-2bcee3133210 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.372004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4dd8-2e07-4db7-9cf8-2bcee3133210 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.372928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f4dd8-2e07-4db7-9cf8-2bcee3133210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:54.373438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f4dd8-2e07-4db7-9cf8-2bcee3133210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-792e3d6b-eb4d-41f8-a5c1-8c2f46335a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:54.373641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:54.374523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:54.375441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:54.375441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:54.375441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:54.375441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:54.375441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 310/599] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:54.376633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fbbb7-7ffb-4dd8-92f2-dcc64a46f230 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.377311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fbbb7-7ffb-4dd8-92f2-dcc64a46f230 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.377907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fbbb7-7ffb-4dd8-92f2-dcc64a46f230 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.379008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f4dd8-2e07-4db7-9cf8-2bcee3133210 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:54.383802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 311/600] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:54.384732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fbbb7-7ffb-4dd8-92f2-dcc64a46f230 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:54.392339 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 290/601] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:54.398545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5465a-c97c-4b66-a7a3-92e27531f1ae None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.399098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5465a-c97c-4b66-a7a3-92e27531f1ae None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.399580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5465a-c97c-4b66-a7a3-92e27531f1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.417327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3aa5465a-c97c-4b66-a7a3-92e27531f1ae None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:54.419076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3aa5465a-c97c-4b66-a7a3-92e27531f1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:54.486835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:54.495452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fbbb7-7ffb-4dd8-92f2-dcc64a46f230 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:54.499576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 291/602] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:54.500596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5465a-c97c-4b66-a7a3-92e27531f1ae None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:54.562969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef153f-d41a-4e3d-b709-8781e7dac2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:54.563657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef153f-d41a-4e3d-b709-8781e7dac2fb None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.563943 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef153f-d41a-4e3d-b709-8781e7dac2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.564227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef153f-d41a-4e3d-b709-8781e7dac2fb None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.564969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef153f-d41a-4e3d-b709-8781e7dac2fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:54.565282 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef153f-d41a-4e3d-b709-8781e7dac2fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:54.566958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef153f-d41a-4e3d-b709-8781e7dac2fb None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:54.580471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 312/603] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:54.581396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef153f-d41a-4e3d-b709-8781e7dac2fb None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:54.607067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5465a-c97c-4b66-a7a3-92e27531f1ae None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:54.647169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a218d32-fadc-455b-bac5-128f062d436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:54.648285 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a218d32-fadc-455b-bac5-128f062d436f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.648747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a218d32-fadc-455b-bac5-128f062d436f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.649161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a218d32-fadc-455b-bac5-128f062d436f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.651130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:54.659879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a218d32-fadc-455b-bac5-128f062d436f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:54.661732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a218d32-fadc-455b-bac5-128f062d436f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7a218d32-fadc-455b-bac5-128f062d436f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:54.677701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:54.678943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:54.680055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:54.680055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:54.680055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:54.680055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:54.680055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:54.680055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:54.680055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:54.680055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:54.682373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 292/604] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:54.683548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a218d32-fadc-455b-bac5-128f062d436f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:54.699557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef153f-d41a-4e3d-b709-8781e7dac2fb None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:54.737891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6f1da-c7ad-46bf-9a9d-379f12118eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:54.738843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6f1da-c7ad-46bf-9a9d-379f12118eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.739133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6f1da-c7ad-46bf-9a9d-379f12118eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.739410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6f1da-c7ad-46bf-9a9d-379f12118eb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.743821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:54.753897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6f1da-c7ad-46bf-9a9d-379f12118eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-10b6f1da-c7ad-46bf-9a9d-379f12118eb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:54.762970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:54.763989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:54.764862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:54.772577 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 313/605] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:54.773789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6f1da-c7ad-46bf-9a9d-379f12118eb0 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:54.796885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a218d32-fadc-455b-bac5-128f062d436f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:54.835638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e80550-2230-43ad-a0a5-6ac97e0aeb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:54.836825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e80550-2230-43ad-a0a5-6ac97e0aeb54 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.836971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e80550-2230-43ad-a0a5-6ac97e0aeb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.837284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e80550-2230-43ad-a0a5-6ac97e0aeb54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.846818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e80550-2230-43ad-a0a5-6ac97e0aeb54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:54.849252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e80550-2230-43ad-a0a5-6ac97e0aeb54 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-c9e80550-2230-43ad-a0a5-6ac97e0aeb54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:54.874550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:54.875520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:54.876867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:54.876867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:54.876867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:54.876867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:54.876867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:54.876867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:54.876867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:54.876867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:54.876867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 293/606] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:54.877372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e80550-2230-43ad-a0a5-6ac97e0aeb54 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:54.899084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6f1da-c7ad-46bf-9a9d-379f12118eb0 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:54.930142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:54.945132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be17f0d-6577-4cf3-a1d9-0ee08d670ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:54.945868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be17f0d-6577-4cf3-a1d9-0ee08d670ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.946158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be17f0d-6577-4cf3-a1d9-0ee08d670ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.946435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be17f0d-6577-4cf3-a1d9-0ee08d670ce9 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.947323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be17f0d-6577-4cf3-a1d9-0ee08d670ce9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:54.947632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be17f0d-6577-4cf3-a1d9-0ee08d670ce9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:54.949150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be17f0d-6577-4cf3-a1d9-0ee08d670ce9 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:54.968705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 314/607] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:54.969746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be17f0d-6577-4cf3-a1d9-0ee08d670ce9 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:55.027221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e80550-2230-43ad-a0a5-6ac97e0aeb54 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:55.042977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:55.063471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3a299-83d8-4bb0-b1fc-4bfc1fdeaabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:55.064211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3a299-83d8-4bb0-b1fc-4bfc1fdeaabf None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:55.064485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3a299-83d8-4bb0-b1fc-4bfc1fdeaabf None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:55.064761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3a299-83d8-4bb0-b1fc-4bfc1fdeaabf None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:55.065568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3a299-83d8-4bb0-b1fc-4bfc1fdeaabf None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:55.065880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3a299-83d8-4bb0-b1fc-4bfc1fdeaabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:55.067300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3a299-83d8-4bb0-b1fc-4bfc1fdeaabf None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:55.080780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 294/608] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:55.082031 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3a299-83d8-4bb0-b1fc-4bfc1fdeaabf None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:55.090855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be17f0d-6577-4cf3-a1d9-0ee08d670ce9 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:55.131511 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbd316-1991-4882-8deb-c68e587610c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:55.132307 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbd316-1991-4882-8deb-c68e587610c0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:55.132736 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbd316-1991-4882-8deb-c68e587610c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:55.133110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbd316-1991-4882-8deb-c68e587610c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:55.134003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbd316-1991-4882-8deb-c68e587610c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:55.134409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbd316-1991-4882-8deb-c68e587610c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:55.135988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbd316-1991-4882-8deb-c68e587610c0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:55.153616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 315/609] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:55.154698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbd316-1991-4882-8deb-c68e587610c0 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:55.193969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3a299-83d8-4bb0-b1fc-4bfc1fdeaabf None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:55.206846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:55.230140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc980aac-5778-4460-a164-2246880d54f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:55.231232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980aac-5778-4460-a164-2246880d54f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:55.231460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980aac-5778-4460-a164-2246880d54f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:55.231740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980aac-5778-4460-a164-2246880d54f1 None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/3748ece05182480f90a70dc587f2a007/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:55.248894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc980aac-5778-4460-a164-2246880d54f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=3748ece05182480f90a70dc587f2a007, role_id=111ab6c88aad4c2b96cc3d7ada1e2dc3)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:55.250702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc980aac-5778-4460-a164-2246880d54f1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:55.270234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 295/610] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:07:55 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/3748ece05182480f90a70dc587f2a007/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:55.272140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc980aac-5778-4460-a164-2246880d54f1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:55.282242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbd316-1991-4882-8deb-c68e587610c0 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:55.306863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:55.326942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030ff9b-9791-44da-a4d3-65151911b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:55.328165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030ff9b-9791-44da-a4d3-65151911b06b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:55.328697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030ff9b-9791-44da-a4d3-65151911b06b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:55.329182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030ff9b-9791-44da-a4d3-65151911b06b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:55.343108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030ff9b-9791-44da-a4d3-65151911b06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:55.345080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030ff9b-9791-44da-a4d3-65151911b06b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-6030ff9b-9791-44da-a4d3-65151911b06b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:55.364599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:55.365587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:55.366522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:55.366522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:55.366522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:55.366522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:55.368521 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 316/611] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:55.374278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030ff9b-9791-44da-a4d3-65151911b06b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:55.430958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc980aac-5778-4460-a164-2246880d54f1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:55.487404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030ff9b-9791-44da-a4d3-65151911b06b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:55.489758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:55.526769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d6abc-5557-4c99-99e4-fd920cfff33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:55.527448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d6abc-5557-4c99-99e4-fd920cfff33f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:55.527727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d6abc-5557-4c99-99e4-fd920cfff33f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:55.528002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d6abc-5557-4c99-99e4-fd920cfff33f None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:55.528798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d6abc-5557-4c99-99e4-fd920cfff33f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:55.529101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d6abc-5557-4c99-99e4-fd920cfff33f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:55.530481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d6abc-5557-4c99-99e4-fd920cfff33f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:55.539818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4db2d-5819-405a-ba7f-5d39d8ed119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:55.540737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4db2d-5819-405a-ba7f-5d39d8ed119f None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:55.541018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4db2d-5819-405a-ba7f-5d39d8ed119f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:55.541294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4db2d-5819-405a-ba7f-5d39d8ed119f None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/0afeafd76edb40289d715f81485fa7bc/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:55.544987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 317/612] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:55.549307 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d6abc-5557-4c99-99e4-fd920cfff33f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:55.561382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4db2d-5819-405a-ba7f-5d39d8ed119f None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=0afeafd76edb40289d715f81485fa7bc, role_id=111ab6c88aad4c2b96cc3d7ada1e2dc3)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:55.564382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4db2d-5819-405a-ba7f-5d39d8ed119f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:55.590110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 296/613] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:07:55 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/0afeafd76edb40289d715f81485fa7bc/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:55.670519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d6abc-5557-4c99-99e4-fd920cfff33f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:55.708983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d895a-fb82-4415-8674-22074edd77fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:55.709721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d895a-fb82-4415-8674-22074edd77fc None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:55.710004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d895a-fb82-4415-8674-22074edd77fc None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:55.710280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d895a-fb82-4415-8674-22074edd77fc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:55.719394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d895a-fb82-4415-8674-22074edd77fc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:55.720920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d895a-fb82-4415-8674-22074edd77fc None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-4f1d895a-fb82-4415-8674-22074edd77fc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:55.737341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:55.738389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:55.739371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 318/614] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:07:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:55.744765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4db2d-5819-405a-ba7f-5d39d8ed119f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:55.896920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:55.942055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4db2d-5819-405a-ba7f-5d39d8ed119f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:56.004323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f250e-1db8-4ee4-801f-5259e9f30827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:56.005388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f250e-1db8-4ee4-801f-5259e9f30827 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.005830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f250e-1db8-4ee4-801f-5259e9f30827 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.006282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f250e-1db8-4ee4-801f-5259e9f30827 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.008065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f250e-1db8-4ee4-801f-5259e9f30827 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:56.008624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f250e-1db8-4ee4-801f-5259e9f30827 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:56.013658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f250e-1db8-4ee4-801f-5259e9f30827 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:56.042810 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 297/615] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 10:07:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:56.048380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deee02d-0a6f-4034-9b58-3099209f3fd7 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.048665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deee02d-0a6f-4034-9b58-3099209f3fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.048943 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deee02d-0a6f-4034-9b58-3099209f3fd7 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.050631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 319/616] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:56.052474 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f250e-1db8-4ee4-801f-5259e9f30827 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:56.055634 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73fe26-2d04-473d-98eb-8010e8f2891f None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.055920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73fe26-2d04-473d-98eb-8010e8f2891f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.056191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73fe26-2d04-473d-98eb-8010e8f2891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.090573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-bd73fe26-2d04-473d-98eb-8010e8f2891f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:56.091799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-bd73fe26-2d04-473d-98eb-8010e8f2891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:56.107041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:56.201767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f250e-1db8-4ee4-801f-5259e9f30827 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:56.238398 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 320/617] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:07:56.253570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:56.260359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103559a9-89d9-4243-8ba2-31c289b8b0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:56.261094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103559a9-89d9-4243-8ba2-31c289b8b0db None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.261374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103559a9-89d9-4243-8ba2-31c289b8b0db None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.261647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103559a9-89d9-4243-8ba2-31c289b8b0db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.273754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103559a9-89d9-4243-8ba2-31c289b8b0db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:56.275312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103559a9-89d9-4243-8ba2-31c289b8b0db None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:56.281966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73fe26-2d04-473d-98eb-8010e8f2891f None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-103559a9-89d9-4243-8ba2-31c289b8b0db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:56.319128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:56.320114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:56.321036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:56.321036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:56.321036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:56.321036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:56.321036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 298/618] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:56.327689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103559a9-89d9-4243-8ba2-31c289b8b0db None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:56.439171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73fe26-2d04-473d-98eb-8010e8f2891f None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:56.463649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103559a9-89d9-4243-8ba2-31c289b8b0db None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:56.485145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da04ec-35d9-4c3a-8b40-e42c4bca275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:56.485956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da04ec-35d9-4c3a-8b40-e42c4bca275f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.486572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da04ec-35d9-4c3a-8b40-e42c4bca275f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.486901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da04ec-35d9-4c3a-8b40-e42c4bca275f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.502992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da04ec-35d9-4c3a-8b40-e42c4bca275f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:56.503422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1e266-5602-46ab-9848-d140b4b55dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:56.504090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1e266-5602-46ab-9848-d140b4b55dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.504365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1e266-5602-46ab-9848-d140b4b55dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.504635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1e266-5602-46ab-9848-d140b4b55dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.505358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1e266-5602-46ab-9848-d140b4b55dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:56.505660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1e266-5602-46ab-9848-d140b4b55dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:56.507086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1e266-5602-46ab-9848-d140b4b55dd7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-02da04ec-35d9-4c3a-8b40-e42c4bca275f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:56.512579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:56.513710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:56.514596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:56.515288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 321/619] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:07:56.517493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b71e85-31bc-4924-b661-b4ae0c6cd3a5 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.519455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b71e85-31bc-4924-b661-b4ae0c6cd3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.519455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b71e85-31bc-4924-b661-b4ae0c6cd3a5 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.519676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 299/620] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:56.519769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 322/621] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:56.524898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1e266-5602-46ab-9848-d140b4b55dd7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:56.527542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b71e85-31bc-4924-b661-b4ae0c6cd3a5 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:56.530467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:56.590870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:56.650320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b71e85-31bc-4924-b661-b4ae0c6cd3a5 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:56.675935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1e266-5602-46ab-9848-d140b4b55dd7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:56.685861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975fd81-181e-4749-b95e-d55b204d04f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:56.686814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975fd81-181e-4749-b95e-d55b204d04f8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.687190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975fd81-181e-4749-b95e-d55b204d04f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.687557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975fd81-181e-4749-b95e-d55b204d04f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.694958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975fd81-181e-4749-b95e-d55b204d04f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:56.696520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975fd81-181e-4749-b95e-d55b204d04f8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-a975fd81-181e-4749-b95e-d55b204d04f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:56.715694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:56.716890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:56.718032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:56.718032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:56.718032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:56.718032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:56.718032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:56.718032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:56.718032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:56.718032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:56.722716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 323/622] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:56.725197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebf3d9-a9ec-4cd6-8879-83e55fdf8bbb None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.725487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebf3d9-a9ec-4cd6-8879-83e55fdf8bbb None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.725769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebf3d9-a9ec-4cd6-8879-83e55fdf8bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.734675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556b573-f483-46c2-aca5-8beffb49bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:56.735744 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b573-f483-46c2-aca5-8beffb49bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.736250 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b573-f483-46c2-aca5-8beffb49bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.736727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b573-f483-46c2-aca5-8beffb49bfc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.737700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556b573-f483-46c2-aca5-8beffb49bfc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:56.738223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556b573-f483-46c2-aca5-8beffb49bfc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:56.739939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556b573-f483-46c2-aca5-8beffb49bfc5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:56.744740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-2eebf3d9-a9ec-4cd6-8879-83e55fdf8bbb None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:56.745998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2eebf3d9-a9ec-4cd6-8879-83e55fdf8bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:56.754877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 300/623] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:56.756110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556b573-f483-46c2-aca5-8beffb49bfc5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:56.809236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:56.821283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 324/624] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:56.822291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebf3d9-a9ec-4cd6-8879-83e55fdf8bbb None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:56.866095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556b573-f483-46c2-aca5-8beffb49bfc5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:56.873974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:56.903614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dae18-7b0f-4eb9-ab54-03ac08ce96ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:56.904646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dae18-7b0f-4eb9-ab54-03ac08ce96ec None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.905174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dae18-7b0f-4eb9-ab54-03ac08ce96ec None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.905639 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dae18-7b0f-4eb9-ab54-03ac08ce96ec None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.906650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dae18-7b0f-4eb9-ab54-03ac08ce96ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:56.907153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dae18-7b0f-4eb9-ab54-03ac08ce96ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:56.909090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dae18-7b0f-4eb9-ab54-03ac08ce96ec None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:56.926535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 301/625] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:56.927791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dae18-7b0f-4eb9-ab54-03ac08ce96ec None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:56.929377 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebf3d9-a9ec-4cd6-8879-83e55fdf8bbb None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:56.966147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb0925-54c1-4bce-9cd9-2d39b6980d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:56.967043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb0925-54c1-4bce-9cd9-2d39b6980d40 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:56.967384 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb0925-54c1-4bce-9cd9-2d39b6980d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:56.967670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb0925-54c1-4bce-9cd9-2d39b6980d40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:56.978989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb0925-54c1-4bce-9cd9-2d39b6980d40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:56.980540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb0925-54c1-4bce-9cd9-2d39b6980d40 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-5fcb0925-54c1-4bce-9cd9-2d39b6980d40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:56.999380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:57.000375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:57.001291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:57.001291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:57.001291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:57.001291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:57.005301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 325/626] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:57.006203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb0925-54c1-4bce-9cd9-2d39b6980d40 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:57.044653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dae18-7b0f-4eb9-ab54-03ac08ce96ec None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:57.056181 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:57.085139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68de777-2b80-4f9a-9e82-d665faf07a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:57.086285 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de777-2b80-4f9a-9e82-d665faf07a38 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:57.086806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de777-2b80-4f9a-9e82-d665faf07a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:57.087289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de777-2b80-4f9a-9e82-d665faf07a38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:57.098717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68de777-2b80-4f9a-9e82-d665faf07a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a68de777-2b80-4f9a-9e82-d665faf07a38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:57.107047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:57.108025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:57.108888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:57.111685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 302/627] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:57.112776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68de777-2b80-4f9a-9e82-d665faf07a38 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:57.118254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb0925-54c1-4bce-9cd9-2d39b6980d40 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:57.143490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:57.155743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6cf6a-42e2-4ec1-ba92-f3da95ad2e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:57.156653 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6cf6a-42e2-4ec1-ba92-f3da95ad2e39 None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:57.156938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6cf6a-42e2-4ec1-ba92-f3da95ad2e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:57.157219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6cf6a-42e2-4ec1-ba92-f3da95ad2e39 None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/b0c07436108d4a2089a74e7891b849c5/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:57.173438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6cf6a-42e2-4ec1-ba92-f3da95ad2e39 None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=b0c07436108d4a2089a74e7891b849c5, role_id=111ab6c88aad4c2b96cc3d7ada1e2dc3)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:57.175060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6cf6a-42e2-4ec1-ba92-f3da95ad2e39 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:57.198668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 326/628] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:07:57 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/b0c07436108d4a2089a74e7891b849c5/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:07:57.200192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6cf6a-42e2-4ec1-ba92-f3da95ad2e39 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:57.236063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68de777-2b80-4f9a-9e82-d665faf07a38 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:57.289032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92d0c4-dc1e-499a-b5ad-72779283515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:57.289718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92d0c4-dc1e-499a-b5ad-72779283515a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:57.290067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92d0c4-dc1e-499a-b5ad-72779283515a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:57.290348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92d0c4-dc1e-499a-b5ad-72779283515a None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:57.294425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92d0c4-dc1e-499a-b5ad-72779283515a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:57.294425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92d0c4-dc1e-499a-b5ad-72779283515a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:57.294425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92d0c4-dc1e-499a-b5ad-72779283515a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:57.322639 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 303/629] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:57.324244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92d0c4-dc1e-499a-b5ad-72779283515a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:57.430194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:57.440671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:57.452204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92d0c4-dc1e-499a-b5ad-72779283515a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:57.460514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6cf6a-42e2-4ec1-ba92-f3da95ad2e39 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:57.497296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ea88-b9fc-449b-8193-668b523bac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:57.498915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ea88-b9fc-449b-8193-668b523bac71 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:57.499227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8155d-f0fa-4526-a4f3-b7544bca88d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:57.499554 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ea88-b9fc-449b-8193-668b523bac71 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:57.499978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ea88-b9fc-449b-8193-668b523bac71 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:57.500272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8155d-f0fa-4526-a4f3-b7544bca88d8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:57.500667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8155d-f0fa-4526-a4f3-b7544bca88d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:57.501074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8155d-f0fa-4526-a4f3-b7544bca88d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:57.501897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8155d-f0fa-4526-a4f3-b7544bca88d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:57.503097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8155d-f0fa-4526-a4f3-b7544bca88d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:57.504669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8155d-f0fa-4526-a4f3-b7544bca88d8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:57.509944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0ea88-b9fc-449b-8193-668b523bac71 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:57.512345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0ea88-b9fc-449b-8193-668b523bac71 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:57.515117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 327/630] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:57.523825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8155d-f0fa-4526-a4f3-b7544bca88d8 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0bc0ea88-b9fc-449b-8193-668b523bac71 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:57.529578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:57.530634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:57.531617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:57.531617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:57.531617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:57.531617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:57.531617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:57.531617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:57.531617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:57.531617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:57.531617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:07:57.531617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:57.535607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 304/631] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:57.543530 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ea88-b9fc-449b-8193-668b523bac71 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:57.685871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ea88-b9fc-449b-8193-668b523bac71 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:57.702896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8155d-f0fa-4526-a4f3-b7544bca88d8 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:57.721677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd426e3-61b6-41d6-aeca-0bed2f977171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:57.722365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd426e3-61b6-41d6-aeca-0bed2f977171 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:57.722685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd426e3-61b6-41d6-aeca-0bed2f977171 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:57.722965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd426e3-61b6-41d6-aeca-0bed2f977171 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:57.723808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd426e3-61b6-41d6-aeca-0bed2f977171 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:57.724134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd426e3-61b6-41d6-aeca-0bed2f977171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:57.725581 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd426e3-61b6-41d6-aeca-0bed2f977171 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:57.745529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 305/632] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 10:07:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:57.769176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd426e3-61b6-41d6-aeca-0bed2f977171 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:57.770858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:57.779390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fcd0c-62e6-4cef-be5e-512a965b240d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:57.780665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fcd0c-62e6-4cef-be5e-512a965b240d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:57.781145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fcd0c-62e6-4cef-be5e-512a965b240d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:57.781625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fcd0c-62e6-4cef-be5e-512a965b240d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:57.801519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fcd0c-62e6-4cef-be5e-512a965b240d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:57.803400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fcd0c-62e6-4cef-be5e-512a965b240d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-4f4fcd0c-62e6-4cef-be5e-512a965b240d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:57.843088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:57.844121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:57.845089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:57.845089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:57.845089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:57.845089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:57.845089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 328/633] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:57.851459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fcd0c-62e6-4cef-be5e-512a965b240d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:57.868939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:57.880874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd426e3-61b6-41d6-aeca-0bed2f977171 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:57.918342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b707da-d200-4f2d-a810-6cebc32477ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:57.919156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b707da-d200-4f2d-a810-6cebc32477ff None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:57.919509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b707da-d200-4f2d-a810-6cebc32477ff None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:57.919850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b707da-d200-4f2d-a810-6cebc32477ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:57.989021 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fcd0c-62e6-4cef-be5e-512a965b240d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:57.992942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b707da-d200-4f2d-a810-6cebc32477ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:57.994560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b707da-d200-4f2d-a810-6cebc32477ff None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:57.997673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:58.028670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a937689-8129-466e-86fe-32c23928d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:58.029770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937689-8129-466e-86fe-32c23928d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.030267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937689-8129-466e-86fe-32c23928d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.030797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937689-8129-466e-86fe-32c23928d7f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.031754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a937689-8129-466e-86fe-32c23928d7f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:58.032280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a937689-8129-466e-86fe-32c23928d7f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:58.034217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a937689-8129-466e-86fe-32c23928d7f0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:58.050673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 329/634] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:07:58.052124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe60c4a-0de3-4aa1-85df-cbd893d2c61e None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.054726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe60c4a-0de3-4aa1-85df-cbd893d2c61e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.055044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe60c4a-0de3-4aa1-85df-cbd893d2c61e None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.056745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 330/635] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:58.057735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc8e79-c23c-4780-8bbb-e76a6a74d1bc None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.057991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc8e79-c23c-4780-8bbb-e76a6a74d1bc None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.058277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc8e79-c23c-4780-8bbb-e76a6a74d1bc None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.059547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 331/636] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:58.060259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc8e79-c23c-4780-8bbb-e76a6a74d1bc None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:58.115902 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 306/637] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:07:58.120795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268ae8a-be8e-4a91-82d3-2752faaed4e0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.121091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268ae8a-be8e-4a91-82d3-2752faaed4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.121371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268ae8a-be8e-4a91-82d3-2752faaed4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.138628 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:58.144191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a268ae8a-be8e-4a91-82d3-2752faaed4e0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:58.145389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a268ae8a-be8e-4a91-82d3-2752faaed4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:58.180354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc8e79-c23c-4780-8bbb-e76a6a74d1bc None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:58.217562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 307/638] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:58.218775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966617-e24c-4f8f-83ba-ae86c6a121c3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.219064 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966617-e24c-4f8f-83ba-ae86c6a121c3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.219345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966617-e24c-4f8f-83ba-ae86c6a121c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.234855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c361a2-5623-4646-ad99-d125bf4fc3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:58.236063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c361a2-5623-4646-ad99-d125bf4fc3bd None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.236582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c361a2-5623-4646-ad99-d125bf4fc3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.237088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c361a2-5623-4646-ad99-d125bf4fc3bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.247393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c361a2-5623-4646-ad99-d125bf4fc3bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:58.248083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ed966617-e24c-4f8f-83ba-ae86c6a121c3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:58.248859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c361a2-5623-4646-ad99-d125bf4fc3bd None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:58.249280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ed966617-e24c-4f8f-83ba-ae86c6a121c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-54c361a2-5623-4646-ad99-d125bf4fc3bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:07:58.264279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:58.265323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 332/639] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 10:07:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:58.266935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c361a2-5623-4646-ad99-d125bf4fc3bd None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:58.286706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:58.334254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 308/640] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:58.334254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966617-e24c-4f8f-83ba-ae86c6a121c3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:58.388700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c361a2-5623-4646-ad99-d125bf4fc3bd None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:58.417847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:58.428645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea972d-dc7d-4768-957a-2deec9832a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:58.429726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea972d-dc7d-4768-957a-2deec9832a73 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.430336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea972d-dc7d-4768-957a-2deec9832a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.430816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea972d-dc7d-4768-957a-2deec9832a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.444348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea972d-dc7d-4768-957a-2deec9832a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:58.446160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea972d-dc7d-4768-957a-2deec9832a73 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:58.459024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966617-e24c-4f8f-83ba-ae86c6a121c3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-0bea972d-dc7d-4768-957a-2deec9832a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:58.465851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:58.466799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:58.467715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:58.467715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:58.467715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:58.467715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:58.473191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 333/641] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:58.473191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea972d-dc7d-4768-957a-2deec9832a73 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:58.496323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bd33e-d87e-414d-aaf5-f4eff96359cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:58.497186 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bd33e-d87e-414d-aaf5-f4eff96359cd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.497525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bd33e-d87e-414d-aaf5-f4eff96359cd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.498079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bd33e-d87e-414d-aaf5-f4eff96359cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.509456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bd33e-d87e-414d-aaf5-f4eff96359cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5f8bd33e-d87e-414d-aaf5-f4eff96359cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:58.517618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:58.518681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:58.519562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 309/642] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:58.520317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bd33e-d87e-414d-aaf5-f4eff96359cd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:58.552649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:58.586051 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea972d-dc7d-4768-957a-2deec9832a73 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:58.626852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae16f8-1ab0-40d0-81f3-4d1cec09b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:58.627527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae16f8-1ab0-40d0-81f3-4d1cec09b4fd None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.627810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae16f8-1ab0-40d0-81f3-4d1cec09b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.628160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae16f8-1ab0-40d0-81f3-4d1cec09b4fd None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.628911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae16f8-1ab0-40d0-81f3-4d1cec09b4fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:58.629214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae16f8-1ab0-40d0-81f3-4d1cec09b4fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:58.630684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae16f8-1ab0-40d0-81f3-4d1cec09b4fd None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:58.636779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bd33e-d87e-414d-aaf5-f4eff96359cd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:58.649778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 334/643] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 10:07:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:58.650404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae16f8-1ab0-40d0-81f3-4d1cec09b4fd None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:58.679672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac85f95-219a-4075-a388-e59775471493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:58.680708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac85f95-219a-4075-a388-e59775471493 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.681120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac85f95-219a-4075-a388-e59775471493 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.681438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac85f95-219a-4075-a388-e59775471493 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.692140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac85f95-219a-4075-a388-e59775471493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:07:58.693636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1ac85f95-219a-4075-a388-e59775471493 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:07:58.703344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:58.704423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:58.705351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 310/644] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:58.706179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac85f95-219a-4075-a388-e59775471493 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:58.765591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae16f8-1ab0-40d0-81f3-4d1cec09b4fd None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:58.793565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:58.801344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc625b-a830-45c6-9fcb-235608027a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:58.802025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc625b-a830-45c6-9fcb-235608027a55 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.802306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc625b-a830-45c6-9fcb-235608027a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.802622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc625b-a830-45c6-9fcb-235608027a55 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.803360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc625b-a830-45c6-9fcb-235608027a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:58.803684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc625b-a830-45c6-9fcb-235608027a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:58.805051 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc625b-a830-45c6-9fcb-235608027a55 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:58.811755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac85f95-219a-4075-a388-e59775471493 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:58.816765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 335/645] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:58.817764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc625b-a830-45c6-9fcb-235608027a55 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:58.849379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6a592-5628-4795-9046-4a7c62d8667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:58.850044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6a592-5628-4795-9046-4a7c62d8667d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.850327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6a592-5628-4795-9046-4a7c62d8667d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.850628 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6a592-5628-4795-9046-4a7c62d8667d None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.851372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6a592-5628-4795-9046-4a7c62d8667d None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:58.851676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6a592-5628-4795-9046-4a7c62d8667d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:58.853046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6a592-5628-4795-9046-4a7c62d8667d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:58.865909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 311/646] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:58.865909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6a592-5628-4795-9046-4a7c62d8667d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:58.928818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:58.933311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc625b-a830-45c6-9fcb-235608027a55 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:58.968769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6a592-5628-4795-9046-4a7c62d8667d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:58.973124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1509a-873e-4e5b-b496-16665ce9c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:58.973784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1509a-873e-4e5b-b496-16665ce9c20c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.974068 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1509a-873e-4e5b-b496-16665ce9c20c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.974342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1509a-873e-4e5b-b496-16665ce9c20c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.005295 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d69fd-85e3-4fb3-81a4-f5a92bc7814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:59.005974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d69fd-85e3-4fb3-81a4-f5a92bc7814c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.006251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d69fd-85e3-4fb3-81a4-f5a92bc7814c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.006539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d69fd-85e3-4fb3-81a4-f5a92bc7814c None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.007289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d69fd-85e3-4fb3-81a4-f5a92bc7814c None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:59.007593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d69fd-85e3-4fb3-81a4-f5a92bc7814c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.008973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d69fd-85e3-4fb3-81a4-f5a92bc7814c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.017762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 312/647] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:59.018510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d69fd-85e3-4fb3-81a4-f5a92bc7814c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:59.030964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:59.053788 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1509a-873e-4e5b-b496-16665ce9c20c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.055502 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1509a-873e-4e5b-b496-16665ce9c20c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.126842 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d69fd-85e3-4fb3-81a4-f5a92bc7814c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:59.159161 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:59.163516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92fbfa-773c-4753-a2cd-1bdd85f0af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:59.165022 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 336/648] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:07:59.165893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1509a-873e-4e5b-b496-16665ce9c20c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:59.169291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92fbfa-773c-4753-a2cd-1bdd85f0af64 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.169587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92fbfa-773c-4753-a2cd-1bdd85f0af64 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.169866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92fbfa-773c-4753-a2cd-1bdd85f0af64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.177175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92fbfa-773c-4753-a2cd-1bdd85f0af64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.178662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92fbfa-773c-4753-a2cd-1bdd85f0af64 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-de92fbfa-773c-4753-a2cd-1bdd85f0af64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:07:59.193053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:59.194018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:59.195358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:07:59.195358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:07:59.195358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:07:59.195358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:07:59.195358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:07:59.195358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:07:59.195358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:07:59.195358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:59.195358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 313/649] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:59.195358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92fbfa-773c-4753-a2cd-1bdd85f0af64 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:59.266738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:59.279739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1509a-873e-4e5b-b496-16665ce9c20c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:59.303864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92fbfa-773c-4753-a2cd-1bdd85f0af64 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:59.316789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b396622-98bb-43de-9683-54182d019d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:59.317873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b396622-98bb-43de-9683-54182d019d1a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.318247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b396622-98bb-43de-9683-54182d019d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.319003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b396622-98bb-43de-9683-54182d019d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.334102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b396622-98bb-43de-9683-54182d019d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.336195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b396622-98bb-43de-9683-54182d019d1a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.341682 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f21b2-4da4-435b-870f-8e93a157820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:59.342601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f21b2-4da4-435b-870f-8e93a157820e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.342959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f21b2-4da4-435b-870f-8e93a157820e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.343304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f21b2-4da4-435b-870f-8e93a157820e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.354260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f21b2-4da4-435b-870f-8e93a157820e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.355863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f21b2-4da4-435b-870f-8e93a157820e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-2b396622-98bb-43de-9683-54182d019d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:59.356271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:59.357352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:59.358357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:59.358357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:59.358357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:59.358357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:59.358357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 337/650] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:59.358807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b396622-98bb-43de-9683-54182d019d1a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-288f21b2-4da4-435b-870f-8e93a157820e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:59.381734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:59.382751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:59.383673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:59.383673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:59.383673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:59.383673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:07:59.383673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 314/651] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:59.383963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f21b2-4da4-435b-870f-8e93a157820e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:59.419610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:59.473001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b396622-98bb-43de-9683-54182d019d1a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:59.506460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f21b2-4da4-435b-870f-8e93a157820e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:59.510335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807c084-bba3-429a-a4bc-e96e29563e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:59.511177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807c084-bba3-429a-a4bc-e96e29563e9b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.511463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807c084-bba3-429a-a4bc-e96e29563e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.511731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807c084-bba3-429a-a4bc-e96e29563e9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.523111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807c084-bba3-429a-a4bc-e96e29563e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.524600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807c084-bba3-429a-a4bc-e96e29563e9b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.530720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-b807c084-bba3-429a-a4bc-e96e29563e9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:07:59.543093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:07:59.544297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:07:59.545331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:07:59.545331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:07:59.545331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:07:59.545331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:07:59.545331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 338/652] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:07:59.545619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807c084-bba3-429a-a4bc-e96e29563e9b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:59.546656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527bf03-5572-407f-98ea-ba7705d943ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:59.547324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527bf03-5572-407f-98ea-ba7705d943ce None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.547609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527bf03-5572-407f-98ea-ba7705d943ce None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.547919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527bf03-5572-407f-98ea-ba7705d943ce None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.548873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527bf03-5572-407f-98ea-ba7705d943ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:59.549449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527bf03-5572-407f-98ea-ba7705d943ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.550994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527bf03-5572-407f-98ea-ba7705d943ce None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.563431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 315/653] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:59.564250 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527bf03-5572-407f-98ea-ba7705d943ce None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:59.647575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807c084-bba3-429a-a4bc-e96e29563e9b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:59.649252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:59.667283 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527bf03-5572-407f-98ea-ba7705d943ce None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:59.682577 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d95d-cfc0-4c8e-8e46-80586fe97cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:59.683243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d95d-cfc0-4c8e-8e46-80586fe97cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.683524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d95d-cfc0-4c8e-8e46-80586fe97cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.683799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d95d-cfc0-4c8e-8e46-80586fe97cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.684546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d95d-cfc0-4c8e-8e46-80586fe97cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:59.684851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d95d-cfc0-4c8e-8e46-80586fe97cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.686227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d95d-cfc0-4c8e-8e46-80586fe97cb1 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.697628 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 339/654] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:59.698910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488a23-e154-4904-9915-e40808ccee6d None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.699226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488a23-e154-4904-9915-e40808ccee6d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.699496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488a23-e154-4904-9915-e40808ccee6d None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.700742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 340/655] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:59.701421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12488a23-e154-4904-9915-e40808ccee6d None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:59.706200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfb5e7-fbe2-46ff-ab6a-055b6d2530bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:59.706910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfb5e7-fbe2-46ff-ab6a-055b6d2530bc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.707190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfb5e7-fbe2-46ff-ab6a-055b6d2530bc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.707462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfb5e7-fbe2-46ff-ab6a-055b6d2530bc None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.708200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfb5e7-fbe2-46ff-ab6a-055b6d2530bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:59.708507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfb5e7-fbe2-46ff-ab6a-055b6d2530bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.709891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfb5e7-fbe2-46ff-ab6a-055b6d2530bc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.723367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 316/656] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:59.724203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfb5e7-fbe2-46ff-ab6a-055b6d2530bc None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:59.771538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:59.811309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12488a23-e154-4904-9915-e40808ccee6d None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:59.831543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfb5e7-fbe2-46ff-ab6a-055b6d2530bc None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:59.845845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26ae5-8032-4ee0-a9da-89a3c660898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:59.846533 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26ae5-8032-4ee0-a9da-89a3c660898d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.846829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26ae5-8032-4ee0-a9da-89a3c660898d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.847106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26ae5-8032-4ee0-a9da-89a3c660898d None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.847826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd26ae5-8032-4ee0-a9da-89a3c660898d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:59.848134 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd26ae5-8032-4ee0-a9da-89a3c660898d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.849505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd26ae5-8032-4ee0-a9da-89a3c660898d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.861867 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 341/657] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:59.862852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26ae5-8032-4ee0-a9da-89a3c660898d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:59.868143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1c2c6-a482-48bf-bbfc-008b7445f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:59.868804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1c2c6-a482-48bf-bbfc-008b7445f32f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.869086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1c2c6-a482-48bf-bbfc-008b7445f32f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.869357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1c2c6-a482-48bf-bbfc-008b7445f32f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.870182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1c2c6-a482-48bf-bbfc-008b7445f32f None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=e0055a33a380435d83a6d7384417c10f) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:07:59.870491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1c2c6-a482-48bf-bbfc-008b7445f32f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:59.871996 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1c2c6-a482-48bf-bbfc-008b7445f32f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:59.878095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 317/658] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/role_assignments?user.id=e0055a33a380435d83a6d7384417c10f&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:07:59.879324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575e7e9-c296-408f-a35b-437fa828ba3b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:59.879595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575e7e9-c296-408f-a35b-437fa828ba3b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:59.879871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575e7e9-c296-408f-a35b-437fa828ba3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:59.889980 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:59.910650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a575e7e9-c296-408f-a35b-437fa828ba3b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:59.912224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a575e7e9-c296-408f-a35b-437fa828ba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:59.980006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26ae5-8032-4ee0-a9da-89a3c660898d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:59.995028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 318/659] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:07:59.995028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575e7e9-c296-408f-a35b-437fa828ba3b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:00.027332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe557c87-5024-4cbe-b91f-d28477e728e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.028567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe557c87-5024-4cbe-b91f-d28477e728e1 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.029122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe557c87-5024-4cbe-b91f-d28477e728e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.029405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe557c87-5024-4cbe-b91f-d28477e728e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.037947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:00.040599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe557c87-5024-4cbe-b91f-d28477e728e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:00.041828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe557c87-5024-4cbe-b91f-d28477e728e1 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-fe557c87-5024-4cbe-b91f-d28477e728e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:00.057842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:00.058947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:00.061097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:00.061097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:00.061097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:00.061097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:00.061097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:00.061097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:00.061097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:00.061097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:00.061097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:08:00.061097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:00.063840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 342/660] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:00.064948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe557c87-5024-4cbe-b91f-d28477e728e1 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:00.118978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575e7e9-c296-408f-a35b-437fa828ba3b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:00.154845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aafe2-c1a7-4583-beb7-4d18f66323a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.155641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aafe2-c1a7-4583-beb7-4d18f66323a4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.155921 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aafe2-c1a7-4583-beb7-4d18f66323a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.156199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aafe2-c1a7-4583-beb7-4d18f66323a4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.160233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:00.165322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aafe2-c1a7-4583-beb7-4d18f66323a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:00.166795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aafe2-c1a7-4583-beb7-4d18f66323a4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:00.182057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe557c87-5024-4cbe-b91f-d28477e728e1 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5f9aafe2-c1a7-4583-beb7-4d18f66323a4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:00.182750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:00.183719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:00.184745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 319/661] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:07:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:00.185370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aafe2-c1a7-4583-beb7-4d18f66323a4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:00.223047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf3e16-df9d-434d-993a-fece696cfeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.223849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf3e16-df9d-434d-993a-fece696cfeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.224133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf3e16-df9d-434d-993a-fece696cfeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.224405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf3e16-df9d-434d-993a-fece696cfeb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.232029 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf3e16-df9d-434d-993a-fece696cfeb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:00.233112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf3e16-df9d-434d-993a-fece696cfeb8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-6ccf3e16-df9d-434d-993a-fece696cfeb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:00.247220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:00.248375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:00.249328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:00.249328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:00.249328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:00.249328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:00.249328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:00.249328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:00.249328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:00.249328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:00.249328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 343/662] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:00.249932 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf3e16-df9d-434d-993a-fece696cfeb8 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:00.293742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:00.301685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aafe2-c1a7-4583-beb7-4d18f66323a4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:00.337732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69db756-04ba-403d-b8d7-9ec861d57c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.338450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db756-04ba-403d-b8d7-9ec861d57c6c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.338762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db756-04ba-403d-b8d7-9ec861d57c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.339037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db756-04ba-403d-b8d7-9ec861d57c6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.350963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69db756-04ba-403d-b8d7-9ec861d57c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b69db756-04ba-403d-b8d7-9ec861d57c6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:00.359051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:00.360091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:00.360956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 320/663] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:08:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:00.361683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69db756-04ba-403d-b8d7-9ec861d57c6c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:00.374941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf3e16-df9d-434d-993a-fece696cfeb8 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:00.412351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e56ba-7a8d-42b1-b7ff-a1ace250ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.412949 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e56ba-7a8d-42b1-b7ff-a1ace250ff5e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.413229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e56ba-7a8d-42b1-b7ff-a1ace250ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.413500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e56ba-7a8d-42b1-b7ff-a1ace250ff5e None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.414341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e56ba-7a8d-42b1-b7ff-a1ace250ff5e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:00.414682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e56ba-7a8d-42b1-b7ff-a1ace250ff5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:00.416126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e56ba-7a8d-42b1-b7ff-a1ace250ff5e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:00.430888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:00.435040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 344/664] 10.222.0.66 () {56 vars in 1139 bytes} [Wed Jun 22 10:08:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:00.435862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e56ba-7a8d-42b1-b7ff-a1ace250ff5e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:00.475730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69db756-04ba-403d-b8d7-9ec861d57c6c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:00.511522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911319fd-b118-494f-9489-fa0c7e9741da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.512193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911319fd-b118-494f-9489-fa0c7e9741da None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.512515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911319fd-b118-494f-9489-fa0c7e9741da None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.513225 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911319fd-b118-494f-9489-fa0c7e9741da None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.514078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911319fd-b118-494f-9489-fa0c7e9741da None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:00.514385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911319fd-b118-494f-9489-fa0c7e9741da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:00.516515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911319fd-b118-494f-9489-fa0c7e9741da None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:00.537210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 321/665] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 10:08:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:00.538379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911319fd-b118-494f-9489-fa0c7e9741da None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:00.538898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e56ba-7a8d-42b1-b7ff-a1ace250ff5e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:00.556321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:00.575817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288428-286b-4d32-b9a9-ba789f8f7def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.576491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288428-286b-4d32-b9a9-ba789f8f7def None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.576776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288428-286b-4d32-b9a9-ba789f8f7def None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.577054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288428-286b-4d32-b9a9-ba789f8f7def None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.577848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63288428-286b-4d32-b9a9-ba789f8f7def None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:00.578163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63288428-286b-4d32-b9a9-ba789f8f7def None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:00.579676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63288428-286b-4d32-b9a9-ba789f8f7def None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:00.591677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 345/666] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:00.592436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288428-286b-4d32-b9a9-ba789f8f7def None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:00.660214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:00.666248 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911319fd-b118-494f-9489-fa0c7e9741da None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:00.703318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595960f4-30db-4d02-ac65-400e518e2c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.703728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288428-286b-4d32-b9a9-ba789f8f7def None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:00.703994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595960f4-30db-4d02-ac65-400e518e2c9d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.704281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595960f4-30db-4d02-ac65-400e518e2c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.704561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595960f4-30db-4d02-ac65-400e518e2c9d None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.705316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595960f4-30db-4d02-ac65-400e518e2c9d None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:00.705652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595960f4-30db-4d02-ac65-400e518e2c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:00.707076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595960f4-30db-4d02-ac65-400e518e2c9d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:00.715983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 322/667] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:08:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:00.716640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595960f4-30db-4d02-ac65-400e518e2c9d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:00.743079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbedb6-2cac-4364-b13f-fee5efb7a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.743729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbedb6-2cac-4364-b13f-fee5efb7a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.744013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbedb6-2cac-4364-b13f-fee5efb7a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.744283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbedb6-2cac-4364-b13f-fee5efb7a5e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.801147 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:00.830833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbedb6-2cac-4364-b13f-fee5efb7a5e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:00.832576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbedb6-2cac-4364-b13f-fee5efb7a5e6 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:00.832965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595960f4-30db-4d02-ac65-400e518e2c9d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:00.869883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25388e36-fa66-4b5e-9ae3-170ac99355b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.870560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25388e36-fa66-4b5e-9ae3-170ac99355b8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.870849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25388e36-fa66-4b5e-9ae3-170ac99355b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.871125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25388e36-fa66-4b5e-9ae3-170ac99355b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.900177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:00.945168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25388e36-fa66-4b5e-9ae3-170ac99355b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:00.946702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25388e36-fa66-4b5e-9ae3-170ac99355b8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:00.953740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 346/668] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:00.953740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbedb6-2cac-4364-b13f-fee5efb7a5e6 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.026799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:01.059322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 323/669] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:01.060026 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25388e36-fa66-4b5e-9ae3-170ac99355b8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.073566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbedb6-2cac-4364-b13f-fee5efb7a5e6 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:01.111121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd691497-9210-4b85-a5be-fca920aad509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:01.112064 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd691497-9210-4b85-a5be-fca920aad509 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:01.112364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd691497-9210-4b85-a5be-fca920aad509 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:01.112646 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd691497-9210-4b85-a5be-fca920aad509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:01.113495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd691497-9210-4b85-a5be-fca920aad509 None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=f91c2e9ae8844d9181aff785c02cf3be) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:01.113867 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd691497-9210-4b85-a5be-fca920aad509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:01.115788 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd691497-9210-4b85-a5be-fca920aad509 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:01.123216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 347/670] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:00 2022] GET /identity/v3/role_assignments?user.id=f91c2e9ae8844d9181aff785c02cf3be&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:01.124078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd691497-9210-4b85-a5be-fca920aad509 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.163803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:01.179961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25388e36-fa66-4b5e-9ae3-170ac99355b8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:01.218891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be28cd-aae0-48e1-9ac2-c419dfd0c2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:01.220166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be28cd-aae0-48e1-9ac2-c419dfd0c2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:01.220658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be28cd-aae0-48e1-9ac2-c419dfd0c2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:01.221215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be28cd-aae0-48e1-9ac2-c419dfd0c2c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:01.234158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be28cd-aae0-48e1-9ac2-c419dfd0c2c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:01.236037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be28cd-aae0-48e1-9ac2-c419dfd0c2c1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:01.250193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd691497-9210-4b85-a5be-fca920aad509 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-90be28cd-aae0-48e1-9ac2-c419dfd0c2c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:01.257376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:01.258363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:01.259345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:01.259345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:01.259345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:01.259345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:01.261963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 324/671] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:01.263328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be28cd-aae0-48e1-9ac2-c419dfd0c2c1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.295486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:01.305322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd7184-08c9-41fa-a211-9a7631d9d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:01.306481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7184-08c9-41fa-a211-9a7631d9d80c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:01.307609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7184-08c9-41fa-a211-9a7631d9d80c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:01.307894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7184-08c9-41fa-a211-9a7631d9d80c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:01.320745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd7184-08c9-41fa-a211-9a7631d9d80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:01.322810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd7184-08c9-41fa-a211-9a7631d9d80c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-0ebd7184-08c9-41fa-a211-9a7631d9d80c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:01.348623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:01.349620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:01.354990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:01.354990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:01.354990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:01.354990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:01.354990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 348/672] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:01.354990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd7184-08c9-41fa-a211-9a7631d9d80c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.393278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be28cd-aae0-48e1-9ac2-c419dfd0c2c1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:01.438542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cb240-8258-49ee-a2ab-0744e1b3b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:01.438542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cb240-8258-49ee-a2ab-0744e1b3b2cc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:01.438542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cb240-8258-49ee-a2ab-0744e1b3b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:01.438542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cb240-8258-49ee-a2ab-0744e1b3b2cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:01.445618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:01.452334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cb240-8258-49ee-a2ab-0744e1b3b2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:01.454624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cb240-8258-49ee-a2ab-0744e1b3b2cc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:01.470729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd7184-08c9-41fa-a211-9a7631d9d80c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-900cb240-8258-49ee-a2ab-0744e1b3b2cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:01.477404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:01.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:01.479351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:01.479351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:01.479351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:01.479351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:01.479577 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 325/673] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:01.480403 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cb240-8258-49ee-a2ab-0744e1b3b2cc None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.513920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07670f76-b495-466b-926a-d1499c4f6f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:01.514946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07670f76-b495-466b-926a-d1499c4f6f62 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:01.515386 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07670f76-b495-466b-926a-d1499c4f6f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:01.515786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07670f76-b495-466b-926a-d1499c4f6f62 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:01.516552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07670f76-b495-466b-926a-d1499c4f6f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:01.517036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07670f76-b495-466b-926a-d1499c4f6f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:01.519066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07670f76-b495-466b-926a-d1499c4f6f62 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:01.534299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 349/674] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:01.539295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07670f76-b495-466b-926a-d1499c4f6f62 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.585434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:01.616314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cb240-8258-49ee-a2ab-0744e1b3b2cc None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:01.648774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07670f76-b495-466b-926a-d1499c4f6f62 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:01.671523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca04fb-579a-4157-bb2b-89cc310efa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:01.672677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca04fb-579a-4157-bb2b-89cc310efa55 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:01.673027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca04fb-579a-4157-bb2b-89cc310efa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:01.673376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca04fb-579a-4157-bb2b-89cc310efa55 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:01.674196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca04fb-579a-4157-bb2b-89cc310efa55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:01.674605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca04fb-579a-4157-bb2b-89cc310efa55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:01.676637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca04fb-579a-4157-bb2b-89cc310efa55 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:01.691550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173be6a2-4a72-45dc-9b44-a6f31e934187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:01.692547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173be6a2-4a72-45dc-9b44-a6f31e934187 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:01.693005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173be6a2-4a72-45dc-9b44-a6f31e934187 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:01.693454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173be6a2-4a72-45dc-9b44-a6f31e934187 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:01.694407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173be6a2-4a72-45dc-9b44-a6f31e934187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:01.694983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173be6a2-4a72-45dc-9b44-a6f31e934187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:01.695103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 326/675] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:01.696605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca04fb-579a-4157-bb2b-89cc310efa55 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.696881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173be6a2-4a72-45dc-9b44-a6f31e934187 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:01.700849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:01.717050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 350/676] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:01.718324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173be6a2-4a72-45dc-9b44-a6f31e934187 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.819923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca04fb-579a-4157-bb2b-89cc310efa55 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:01.854189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173be6a2-4a72-45dc-9b44-a6f31e934187 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:01.855936 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0316a4c-00f4-4df8-9aad-be5fb80c8b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:01.857109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316a4c-00f4-4df8-9aad-be5fb80c8b78 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:01.857635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316a4c-00f4-4df8-9aad-be5fb80c8b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:01.858151 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316a4c-00f4-4df8-9aad-be5fb80c8b78 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:01.866575 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0316a4c-00f4-4df8-9aad-be5fb80c8b78 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:01.868276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0316a4c-00f4-4df8-9aad-be5fb80c8b78 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:01.870549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d0316a4c-00f4-4df8-9aad-be5fb80c8b78 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:01.885038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:01.886065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:01.887517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:01.887517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:01.887517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:01.887517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:01.887517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:01.887517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:01.887517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:01.887517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:01.887517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:08:01.887517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:01.890133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 327/677] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:01.891230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0316a4c-00f4-4df8-9aad-be5fb80c8b78 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.901067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195568f-7b1d-4447-b3fa-d90084ae5e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:01.902206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195568f-7b1d-4447-b3fa-d90084ae5e72 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:01.902747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195568f-7b1d-4447-b3fa-d90084ae5e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:01.903250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195568f-7b1d-4447-b3fa-d90084ae5e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:01.912132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195568f-7b1d-4447-b3fa-d90084ae5e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:01.913877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195568f-7b1d-4447-b3fa-d90084ae5e72 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-8195568f-7b1d-4447-b3fa-d90084ae5e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:01.928841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:01.929804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:01.930770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:01.930770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:01.930770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:01.930770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:01.930770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:01.930770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:01.930770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:01.930770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:01.933446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 351/678] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:01.934817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195568f-7b1d-4447-b3fa-d90084ae5e72 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:01.998416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:02.013333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0316a4c-00f4-4df8-9aad-be5fb80c8b78 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:02.044451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195568f-7b1d-4447-b3fa-d90084ae5e72 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:02.051427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bed1ea-b56e-4090-aa97-cd8a2bf815f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:02.052233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bed1ea-b56e-4090-aa97-cd8a2bf815f6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.052518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bed1ea-b56e-4090-aa97-cd8a2bf815f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.052791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bed1ea-b56e-4090-aa97-cd8a2bf815f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.060302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bed1ea-b56e-4090-aa97-cd8a2bf815f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:02.061753 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bed1ea-b56e-4090-aa97-cd8a2bf815f6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-96bed1ea-b56e-4090-aa97-cd8a2bf815f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:02.076077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:02.077012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:02.083175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:02.083175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:02.083175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:02.083175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:02.083175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:02.083175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:02.083175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:02.083175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:02.083175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 328/679] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:02.083175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bed1ea-b56e-4090-aa97-cd8a2bf815f6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:02.083783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb81d7a-7c9b-4e13-86c3-a08bc5471fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:02.083783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb81d7a-7c9b-4e13-86c3-a08bc5471fda None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.083783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb81d7a-7c9b-4e13-86c3-a08bc5471fda None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.083783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb81d7a-7c9b-4e13-86c3-a08bc5471fda None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.084062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb81d7a-7c9b-4e13-86c3-a08bc5471fda None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:02.084062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb81d7a-7c9b-4e13-86c3-a08bc5471fda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:02.084062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb81d7a-7c9b-4e13-86c3-a08bc5471fda None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:02.106823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 352/680] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 10:08:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:02.106823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f126a9-6462-40b7-bf14-6d34547e643f None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.106823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f126a9-6462-40b7-bf14-6d34547e643f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.106823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f126a9-6462-40b7-bf14-6d34547e643f None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.106823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 353/681] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:02.107881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f126a9-6462-40b7-bf14-6d34547e643f None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:02.150972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:02.195691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bed1ea-b56e-4090-aa97-cd8a2bf815f6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:02.214773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f126a9-6462-40b7-bf14-6d34547e643f None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:02.230001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:02.231899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aae43-ab2c-45ed-b7b4-ff663788c05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:02.232889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aae43-ab2c-45ed-b7b4-ff663788c05c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.233173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aae43-ab2c-45ed-b7b4-ff663788c05c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.233445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aae43-ab2c-45ed-b7b4-ff663788c05c None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.234382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727aae43-ab2c-45ed-b7b4-ff663788c05c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:02.234722 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727aae43-ab2c-45ed-b7b4-ff663788c05c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:02.236310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727aae43-ab2c-45ed-b7b4-ff663788c05c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:02.252661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 329/682] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:02.252661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aae43-ab2c-45ed-b7b4-ff663788c05c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:02.259036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cf23f-0538-4e46-8960-23d83e6965ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:02.259864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cf23f-0538-4e46-8960-23d83e6965ff None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.260150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cf23f-0538-4e46-8960-23d83e6965ff None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.260426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cf23f-0538-4e46-8960-23d83e6965ff None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.261224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cf23f-0538-4e46-8960-23d83e6965ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:02.261661 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cf23f-0538-4e46-8960-23d83e6965ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:02.263383 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cf23f-0538-4e46-8960-23d83e6965ff None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:02.281458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 354/683] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:02.281458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789766e-4e47-4719-b759-7a322c53da5f None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.281458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789766e-4e47-4719-b759-7a322c53da5f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.281458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789766e-4e47-4719-b759-7a322c53da5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.299122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-f789766e-4e47-4719-b759-7a322c53da5f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:02.300404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f789766e-4e47-4719-b759-7a322c53da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:02.354987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aae43-ab2c-45ed-b7b4-ff663788c05c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:02.370621 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 355/684] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:08:02.371832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789766e-4e47-4719-b759-7a322c53da5f None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:02.383943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:02.406437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a112a4-c216-4212-b1f7-4593e2d60d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:02.407132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a112a4-c216-4212-b1f7-4593e2d60d02 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.407412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a112a4-c216-4212-b1f7-4593e2d60d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.407686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a112a4-c216-4212-b1f7-4593e2d60d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.477815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789766e-4e47-4719-b759-7a322c53da5f None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:02.478196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a112a4-c216-4212-b1f7-4593e2d60d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:02.479719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a112a4-c216-4212-b1f7-4593e2d60d02 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:02.481068 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:02.515931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a695b0-6075-48b3-b5bd-d6a2d53e58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:02.516735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a695b0-6075-48b3-b5bd-d6a2d53e58f6 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.516976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a695b0-6075-48b3-b5bd-d6a2d53e58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.517256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a695b0-6075-48b3-b5bd-d6a2d53e58f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.518081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a695b0-6075-48b3-b5bd-d6a2d53e58f6 None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=0afeafd76edb40289d715f81485fa7bc) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:02.518390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a695b0-6075-48b3-b5bd-d6a2d53e58f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:02.519855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a695b0-6075-48b3-b5bd-d6a2d53e58f6 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:02.526298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 356/685] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:02 2022] GET /identity/v3/role_assignments?user.id=0afeafd76edb40289d715f81485fa7bc&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:02.527074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a695b0-6075-48b3-b5bd-d6a2d53e58f6 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:02.621878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 330/686] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:02.623532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a112a4-c216-4212-b1f7-4593e2d60d02 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:02.650408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:02.652411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a695b0-6075-48b3-b5bd-d6a2d53e58f6 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:02.694007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8bd95-90f9-42d1-8604-7554793ac7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:02.694707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8bd95-90f9-42d1-8604-7554793ac7cd None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.694989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8bd95-90f9-42d1-8604-7554793ac7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.695262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8bd95-90f9-42d1-8604-7554793ac7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.696102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8bd95-90f9-42d1-8604-7554793ac7cd None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=3748ece05182480f90a70dc587f2a007) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:02.696406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8bd95-90f9-42d1-8604-7554793ac7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:02.698028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8bd95-90f9-42d1-8604-7554793ac7cd None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:02.706418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 357/687] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:02 2022] GET /identity/v3/role_assignments?user.id=3748ece05182480f90a70dc587f2a007&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:02.707268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8bd95-90f9-42d1-8604-7554793ac7cd None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:02.756405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:02.775020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a112a4-c216-4212-b1f7-4593e2d60d02 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:02.818836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf9abb-2d4f-43d7-a2b3-d753362e75b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:02.819657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf9abb-2d4f-43d7-a2b3-d753362e75b7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.819937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf9abb-2d4f-43d7-a2b3-d753362e75b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.820203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf9abb-2d4f-43d7-a2b3-d753362e75b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.833999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf9abb-2d4f-43d7-a2b3-d753362e75b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:02.835864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf9abb-2d4f-43d7-a2b3-d753362e75b7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:02.852548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8bd95-90f9-42d1-8604-7554793ac7cd None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5aaf9abb-2d4f-43d7-a2b3-d753362e75b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:02.856900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:02.857861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:02.858864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:02.858864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:02.858864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:02.858864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:02.858864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 331/688] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:02.867676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf9abb-2d4f-43d7-a2b3-d753362e75b7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:02.904580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd9c4c-e335-475c-b8f8-0463e2df9f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:02.906117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd9c4c-e335-475c-b8f8-0463e2df9f50 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:02.907039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd9c4c-e335-475c-b8f8-0463e2df9f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:02.907781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd9c4c-e335-475c-b8f8-0463e2df9f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:02.923422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd9c4c-e335-475c-b8f8-0463e2df9f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:02.925027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd9c4c-e335-475c-b8f8-0463e2df9f50 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-cccd9c4c-e335-475c-b8f8-0463e2df9f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:02.948279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:02.949277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:02.950255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:02.950255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:02.950255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:02.950255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:02.950255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 358/689] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:02.959292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:02.960557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd9c4c-e335-475c-b8f8-0463e2df9f50 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:03.000863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf9abb-2d4f-43d7-a2b3-d753362e75b7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:03.039094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d64fac-d84a-4db3-866a-4334155c156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:03.040132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d64fac-d84a-4db3-866a-4334155c156f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.040639 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d64fac-d84a-4db3-866a-4334155c156f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.041185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d64fac-d84a-4db3-866a-4334155c156f None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.042243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d64fac-d84a-4db3-866a-4334155c156f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:03.042788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d64fac-d84a-4db3-866a-4334155c156f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:03.044433 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d64fac-d84a-4db3-866a-4334155c156f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:03.056855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:03.059741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 332/690] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:03.066114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d64fac-d84a-4db3-866a-4334155c156f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:03.074773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd9c4c-e335-475c-b8f8-0463e2df9f50 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:03.120296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a861bb-7043-46d9-9b7f-77eec223433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:03.120880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a861bb-7043-46d9-9b7f-77eec223433f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.121157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a861bb-7043-46d9-9b7f-77eec223433f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.121428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a861bb-7043-46d9-9b7f-77eec223433f None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.122262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a861bb-7043-46d9-9b7f-77eec223433f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:03.122609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a861bb-7043-46d9-9b7f-77eec223433f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:03.124034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a861bb-7043-46d9-9b7f-77eec223433f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:03.142652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 359/691] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:03.144250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a861bb-7043-46d9-9b7f-77eec223433f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:03.209650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d64fac-d84a-4db3-866a-4334155c156f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:03.242330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:03.259155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc61c89-5107-4f9b-a52a-acaca3ec617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:03.259836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc61c89-5107-4f9b-a52a-acaca3ec617d None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.261592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc61c89-5107-4f9b-a52a-acaca3ec617d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.261877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc61c89-5107-4f9b-a52a-acaca3ec617d None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.264789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc61c89-5107-4f9b-a52a-acaca3ec617d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:03.266565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc61c89-5107-4f9b-a52a-acaca3ec617d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:03.297377 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a861bb-7043-46d9-9b7f-77eec223433f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:03.304966 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 333/692] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:08:03 2022] POST /identity/v3/users => generated 254 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:03.353125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d635b58-7e36-4d59-a0ad-6da3c182c198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:03.354050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635b58-7e36-4d59-a0ad-6da3c182c198 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.354421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635b58-7e36-4d59-a0ad-6da3c182c198 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.354728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635b58-7e36-4d59-a0ad-6da3c182c198 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.365548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d635b58-7e36-4d59-a0ad-6da3c182c198 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:03.367181 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d635b58-7e36-4d59-a0ad-6da3c182c198 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-4d635b58-7e36-4d59-a0ad-6da3c182c198 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:03.382891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:03.383971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:03.384889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:03.384889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:03.384889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:03.384889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:03.384889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:03.384889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:03.384889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:03.384889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:03.389204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 360/693] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:03.390833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc61c89-5107-4f9b-a52a-acaca3ec617d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:03.461474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966e22b-de9f-4030-893c-e910bf729233 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.462141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966e22b-de9f-4030-893c-e910bf729233 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.462723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966e22b-de9f-4030-893c-e910bf729233 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.464689 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 361/694] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:03.470495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2ad9-ad31-451c-9150-6c70e684c437 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.471076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2ad9-ad31-451c-9150-6c70e684c437 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.471551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2ad9-ad31-451c-9150-6c70e684c437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.487789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:03.511484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-562e2ad9-ad31-451c-9150-6c70e684c437 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:03.512831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-562e2ad9-ad31-451c-9150-6c70e684c437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:03.544689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc61c89-5107-4f9b-a52a-acaca3ec617d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:03.600617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81edc8-a88f-4fa8-b75a-a949a050e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:03.601653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81edc8-a88f-4fa8-b75a-a949a050e684 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.602117 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81edc8-a88f-4fa8-b75a-a949a050e684 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.602692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81edc8-a88f-4fa8-b75a-a949a050e684 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.603671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81edc8-a88f-4fa8-b75a-a949a050e684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:03.604194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81edc8-a88f-4fa8-b75a-a949a050e684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:03.607972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81edc8-a88f-4fa8-b75a-a949a050e684 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:03.622086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 334/695] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:03.627914 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81edc8-a88f-4fa8-b75a-a949a050e684 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:03.652127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 362/696] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:08:03.682358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e2ad9-ad31-451c-9150-6c70e684c437 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:03.688340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:03.765334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81edc8-a88f-4fa8-b75a-a949a050e684 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:03.802684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e2ad9-ad31-451c-9150-6c70e684c437 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:03.813898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34447-bc6a-47fb-910c-52563cd82be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:03.814203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34447-bc6a-47fb-910c-52563cd82be2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.814447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34447-bc6a-47fb-910c-52563cd82be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.814754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34447-bc6a-47fb-910c-52563cd82be2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.815588 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34447-bc6a-47fb-910c-52563cd82be2 None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=b0c07436108d4a2089a74e7891b849c5) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:03.816096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34447-bc6a-47fb-910c-52563cd82be2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:03.817528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34447-bc6a-47fb-910c-52563cd82be2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:03.824161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 335/697] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:03 2022] GET /identity/v3/role_assignments?user.id=b0c07436108d4a2089a74e7891b849c5&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:03.847588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2fea5-6b59-476b-8a88-8496ac133405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:03.848414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2fea5-6b59-476b-8a88-8496ac133405 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.848697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2fea5-6b59-476b-8a88-8496ac133405 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.848974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2fea5-6b59-476b-8a88-8496ac133405 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.854914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:03.863042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2fea5-6b59-476b-8a88-8496ac133405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-1ff2fea5-6b59-476b-8a88-8496ac133405 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:03.871638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:03.872908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:03.873996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:03.876791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 363/698] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:03.882855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34447-bc6a-47fb-910c-52563cd82be2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:04.002980 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34447-bc6a-47fb-910c-52563cd82be2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:04.015678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:04.048994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7e4f4-088c-4919-89de-1b38d16482c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:04.049883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7e4f4-088c-4919-89de-1b38d16482c4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:04.050283 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7e4f4-088c-4919-89de-1b38d16482c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:04.050694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7e4f4-088c-4919-89de-1b38d16482c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:04.051621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7e4f4-088c-4919-89de-1b38d16482c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:04.052060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7e4f4-088c-4919-89de-1b38d16482c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:04.053666 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7e4f4-088c-4919-89de-1b38d16482c4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:04.064668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 336/699] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:08:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:04.070453 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2fea5-6b59-476b-8a88-8496ac133405 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:04.183573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2fea5-6b59-476b-8a88-8496ac133405 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:04.220657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939a5af-a688-481d-a77c-f6befb825e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:04.221455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a5af-a688-481d-a77c-f6befb825e0c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:04.221745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a5af-a688-481d-a77c-f6befb825e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:04.222006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a5af-a688-481d-a77c-f6befb825e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:04.232988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939a5af-a688-481d-a77c-f6befb825e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:04.234473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939a5af-a688-481d-a77c-f6befb825e0c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-e939a5af-a688-481d-a77c-f6befb825e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:04.252321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:04.254542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:04.255589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:04.255589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:04.255589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:04.255589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:04.255589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 364/700] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:04.259674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7e4f4-088c-4919-89de-1b38d16482c4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:04.390606 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7e4f4-088c-4919-89de-1b38d16482c4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:04.460671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae9513-87cb-4ed1-91dd-f361cd366c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:04.461266 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae9513-87cb-4ed1-91dd-f361cd366c3f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:04.461546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae9513-87cb-4ed1-91dd-f361cd366c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:04.461816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae9513-87cb-4ed1-91dd-f361cd366c3f None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:04.462699 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae9513-87cb-4ed1-91dd-f361cd366c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:04.462986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae9513-87cb-4ed1-91dd-f361cd366c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:04.464377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae9513-87cb-4ed1-91dd-f361cd366c3f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:04.488212 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 337/701] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:04.493839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939a5af-a688-481d-a77c-f6befb825e0c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:04.569957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:04.647676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939a5af-a688-481d-a77c-f6befb825e0c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:04.694317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e664361-267f-425f-a179-a1dd7df8d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:04.695163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e664361-267f-425f-a179-a1dd7df8d819 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:04.695446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e664361-267f-425f-a179-a1dd7df8d819 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:04.695722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e664361-267f-425f-a179-a1dd7df8d819 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:04.708831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e664361-267f-425f-a179-a1dd7df8d819 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:04.710311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e664361-267f-425f-a179-a1dd7df8d819 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-3e664361-267f-425f-a179-a1dd7df8d819 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:04.727422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:04.728429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:04.730316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 365/702] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 10:08:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:04.734749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae9513-87cb-4ed1-91dd-f361cd366c3f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:04.789358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:04.890938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae9513-87cb-4ed1-91dd-f361cd366c3f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:04.944678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ed7d5-5517-42b7-babf-fcc1a120074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:04.945370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ed7d5-5517-42b7-babf-fcc1a120074d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:04.945647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ed7d5-5517-42b7-babf-fcc1a120074d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:04.945915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ed7d5-5517-42b7-babf-fcc1a120074d None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:04.946808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ed7d5-5517-42b7-babf-fcc1a120074d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:04.947115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ed7d5-5517-42b7-babf-fcc1a120074d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:04.948559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ed7d5-5517-42b7-babf-fcc1a120074d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:04.975341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 338/703] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 10:08:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:04.980614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e664361-267f-425f-a179-a1dd7df8d819 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:05.143507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e664361-267f-425f-a179-a1dd7df8d819 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:05.157200 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:05.205605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5ac83-c751-4ddf-b1a4-41fe6c67e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:05.206276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ac83-c751-4ddf-b1a4-41fe6c67e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.206585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ac83-c751-4ddf-b1a4-41fe6c67e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.206864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ac83-c751-4ddf-b1a4-41fe6c67e9d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.308781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5ac83-c751-4ddf-b1a4-41fe6c67e9d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:05.310324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5ac83-c751-4ddf-b1a4-41fe6c67e9d4 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:05.364468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905589-9b55-4a84-98e3-52e23cd9c871 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.364767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905589-9b55-4a84-98e3-52e23cd9c871 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.365023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905589-9b55-4a84-98e3-52e23cd9c871 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.366675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 339/704] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:05.374885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ac87f-7c45-4e50-925e-3b9e93e58aff None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.375169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ac87f-7c45-4e50-925e-3b9e93e58aff None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.375423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ac87f-7c45-4e50-925e-3b9e93e58aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.409132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-544ac87f-7c45-4e50-925e-3b9e93e58aff None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:05.410569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-544ac87f-7c45-4e50-925e-3b9e93e58aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:05.445961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 366/705] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:05.447377 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203715c-a0e0-4ec5-aa60-7090feb3f461 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.447670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203715c-a0e0-4ec5-aa60-7090feb3f461 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.447947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203715c-a0e0-4ec5-aa60-7090feb3f461 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.454452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 367/706] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:05.455360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203715c-a0e0-4ec5-aa60-7090feb3f461 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:05.466082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:05.504862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 340/707] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:08:05.506249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517f70-bc71-4a21-8739-8751db4e3f24 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.506637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517f70-bc71-4a21-8739-8751db4e3f24 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.506858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517f70-bc71-4a21-8739-8751db4e3f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.527020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f8517f70-bc71-4a21-8739-8751db4e3f24 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:05.528351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f8517f70-bc71-4a21-8739-8751db4e3f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:05.546038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:05.579092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203715c-a0e0-4ec5-aa60-7090feb3f461 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:05.607477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 341/708] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:08:05.608895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517f70-bc71-4a21-8739-8751db4e3f24 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:05.617632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0a01-0264-4e9a-ae5a-c35f5e6cc7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:05.618795 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0a01-0264-4e9a-ae5a-c35f5e6cc7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.619257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0a01-0264-4e9a-ae5a-c35f5e6cc7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.619705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0a01-0264-4e9a-ae5a-c35f5e6cc7d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.630920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df0a01-0264-4e9a-ae5a-c35f5e6cc7d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:05.632685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df0a01-0264-4e9a-ae5a-c35f5e6cc7d3 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-a8df0a01-0264-4e9a-ae5a-c35f5e6cc7d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:05.653191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:05.654132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:05.655103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:05.655103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:05.655103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:05.655103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:05.657411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 368/709] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:05.663225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0a01-0264-4e9a-ae5a-c35f5e6cc7d3 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:05.718634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517f70-bc71-4a21-8739-8751db4e3f24 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:05.723703 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:05.759005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016c6f5-36ee-4c71-9b4e-a662c1f56a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:05.759845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016c6f5-36ee-4c71-9b4e-a662c1f56a1e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.760130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016c6f5-36ee-4c71-9b4e-a662c1f56a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.760402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016c6f5-36ee-4c71-9b4e-a662c1f56a1e None admin] PATH_INFO: `/v3/services/network` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.761070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016c6f5-36ee-4c71-9b4e-a662c1f56a1e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:05.762766 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016c6f5-36ee-4c71-9b4e-a662c1f56a1e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:05.768624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0a01-0264-4e9a-ae5a-c35f5e6cc7d3 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d016c6f5-36ee-4c71-9b4e-a662c1f56a1e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:05.777419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:05.778615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:08:05.779484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:05.782701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 342/710] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:05 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:05.783981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016c6f5-36ee-4c71-9b4e-a662c1f56a1e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:05.803248 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:05.810202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0414b-b07a-4dd0-98c8-38380c7dc344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:05.811436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0414b-b07a-4dd0-98c8-38380c7dc344 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.811920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0414b-b07a-4dd0-98c8-38380c7dc344 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.812388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0414b-b07a-4dd0-98c8-38380c7dc344 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.813249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0414b-b07a-4dd0-98c8-38380c7dc344 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:05.814922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0414b-b07a-4dd0-98c8-38380c7dc344 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-e7b0414b-b07a-4dd0-98c8-38380c7dc344 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:05.829421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:05.830378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:08:05.831281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:05.834204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 369/711] 10.222.0.66 () {56 vars in 1129 bytes} [Wed Jun 22 10:08:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:05.835308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0414b-b07a-4dd0-98c8-38380c7dc344 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:05.896038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016c6f5-36ee-4c71-9b4e-a662c1f56a1e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:05.933095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e1777-83f5-43f4-9c83-0af613554012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:05.933864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e1777-83f5-43f4-9c83-0af613554012 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.934210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e1777-83f5-43f4-9c83-0af613554012 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.934491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e1777-83f5-43f4-9c83-0af613554012 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.935458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e1777-83f5-43f4-9c83-0af613554012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:05.935737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e1777-83f5-43f4-9c83-0af613554012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:05.937128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e1777-83f5-43f4-9c83-0af613554012 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:05.944690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0414b-b07a-4dd0-98c8-38380c7dc344 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:05.954718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 343/712] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:05.954718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e1777-83f5-43f4-9c83-0af613554012 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:05.973724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:05.986806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6273c8-e750-4186-93fc-d7b4a4c49039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:05.987948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6273c8-e750-4186-93fc-d7b4a4c49039 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.988430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6273c8-e750-4186-93fc-d7b4a4c49039 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.988901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6273c8-e750-4186-93fc-d7b4a4c49039 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.989841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6273c8-e750-4186-93fc-d7b4a4c49039 None admin] RBAC: Adding query filter params (name=network) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:05.990362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6273c8-e750-4186-93fc-d7b4a4c49039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:05.992007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6273c8-e750-4186-93fc-d7b4a4c49039 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:05.997566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 370/713] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:05.998723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6273c8-e750-4186-93fc-d7b4a4c49039 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:06.040596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:06.070371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e1777-83f5-43f4-9c83-0af613554012 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:06.105431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6273c8-e750-4186-93fc-d7b4a4c49039 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:06.109243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcddfbe-1d13-457e-aeef-887c241960fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:06.109926 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcddfbe-1d13-457e-aeef-887c241960fd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.110208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcddfbe-1d13-457e-aeef-887c241960fd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.110483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcddfbe-1d13-457e-aeef-887c241960fd None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.111232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcddfbe-1d13-457e-aeef-887c241960fd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:06.111544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcddfbe-1d13-457e-aeef-887c241960fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:06.112932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcddfbe-1d13-457e-aeef-887c241960fd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:06.118545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 344/714] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 10:08:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:06.119277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcddfbe-1d13-457e-aeef-887c241960fd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:06.147396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3bf09-2290-4ed0-9151-4adb04120c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:06.148218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3bf09-2290-4ed0-9151-4adb04120c4c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.148551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3bf09-2290-4ed0-9151-4adb04120c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.148816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3bf09-2290-4ed0-9151-4adb04120c4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.156336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3bf09-2290-4ed0-9151-4adb04120c4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:06.157828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3bf09-2290-4ed0-9151-4adb04120c4c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-9fa3bf09-2290-4ed0-9151-4adb04120c4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:06.173171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:06.174203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:06.175204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:06.175204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:06.175204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:06.175204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:06.175204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:06.175204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:06.175204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:06.175204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:06.175204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 371/715] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:06.177216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eacf1-7465-4cd7-ac3a-e3116d1d018b None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.177506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eacf1-7465-4cd7-ac3a-e3116d1d018b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.177782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eacf1-7465-4cd7-ac3a-e3116d1d018b None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.182902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 372/716] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:06.182902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eacf1-7465-4cd7-ac3a-e3116d1d018b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:06.234195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcddfbe-1d13-457e-aeef-887c241960fd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:06.239356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:06.270444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c4479-b74b-44aa-a0e6-2e3f7aa54b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:06.271161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4479-b74b-44aa-a0e6-2e3f7aa54b08 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.271442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4479-b74b-44aa-a0e6-2e3f7aa54b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.271715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4479-b74b-44aa-a0e6-2e3f7aa54b08 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.272435 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c4479-b74b-44aa-a0e6-2e3f7aa54b08 None admin] RBAC: Adding query filter params (type=network) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:06.272740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c4479-b74b-44aa-a0e6-2e3f7aa54b08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:06.274118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c4479-b74b-44aa-a0e6-2e3f7aa54b08 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:06.280009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 345/717] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:06.280840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c4479-b74b-44aa-a0e6-2e3f7aa54b08 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:06.284260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:06.332241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eacf1-7465-4cd7-ac3a-e3116d1d018b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:06.388217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2f0d3-b1e9-465a-9c45-70bb440cd4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:06.389915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2f0d3-b1e9-465a-9c45-70bb440cd4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.390402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2f0d3-b1e9-465a-9c45-70bb440cd4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.390882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2f0d3-b1e9-465a-9c45-70bb440cd4c3 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.391802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2f0d3-b1e9-465a-9c45-70bb440cd4c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:06.392292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2f0d3-b1e9-465a-9c45-70bb440cd4c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:06.394615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2f0d3-b1e9-465a-9c45-70bb440cd4c3 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:06.409172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 373/718] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 10:08:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:06.409172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847536c9-5827-4d86-8768-2d94d2a765a1 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.409172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847536c9-5827-4d86-8768-2d94d2a765a1 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.409172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847536c9-5827-4d86-8768-2d94d2a765a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.414226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c4479-b74b-44aa-a0e6-2e3f7aa54b08 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:06.452294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-847536c9-5827-4d86-8768-2d94d2a765a1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:06.453586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-847536c9-5827-4d86-8768-2d94d2a765a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:06.496466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dc4bd-8e17-4835-940a-9a63b401d7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:06.498821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dc4bd-8e17-4835-940a-9a63b401d7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.499107 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dc4bd-8e17-4835-940a-9a63b401d7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.499378 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dc4bd-8e17-4835-940a-9a63b401d7f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.501229 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dc4bd-8e17-4835-940a-9a63b401d7f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:06.501614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dc4bd-8e17-4835-940a-9a63b401d7f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:06.503780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dc4bd-8e17-4835-940a-9a63b401d7f7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:06.524344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 346/719] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:06.530194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dc4bd-8e17-4835-940a-9a63b401d7f7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:06.566840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 374/720] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:08:06.582346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d38ff-ac1c-4da4-84a6-a14bde358e8c None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.583004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d38ff-ac1c-4da4-84a6-a14bde358e8c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.583004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d38ff-ac1c-4da4-84a6-a14bde358e8c None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.584652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 375/721] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:06.590707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80743d58-560a-4d66-8b7a-78008cd9c3ef None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.591023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80743d58-560a-4d66-8b7a-78008cd9c3ef None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.591319 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80743d58-560a-4d66-8b7a-78008cd9c3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.610271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-80743d58-560a-4d66-8b7a-78008cd9c3ef None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:06.611800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-80743d58-560a-4d66-8b7a-78008cd9c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:06.645895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:06.665613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:06.703478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dc4bd-8e17-4835-940a-9a63b401d7f7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:06.707108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 376/722] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:08:06.707724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80743d58-560a-4d66-8b7a-78008cd9c3ef None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:06.747384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d305d5-990d-43d7-8f64-579deb9c221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:06.748491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d305d5-990d-43d7-8f64-579deb9c221d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.748981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d305d5-990d-43d7-8f64-579deb9c221d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.749454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d305d5-990d-43d7-8f64-579deb9c221d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.751150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d305d5-990d-43d7-8f64-579deb9c221d None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=f91c2e9ae8844d9181aff785c02cf3be) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:06.751700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d305d5-990d-43d7-8f64-579deb9c221d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:06.753939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d305d5-990d-43d7-8f64-579deb9c221d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:06.763395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 347/723] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:06 2022] GET /identity/v3/role_assignments?user.id=f91c2e9ae8844d9181aff785c02cf3be&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:06.768911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d305d5-990d-43d7-8f64-579deb9c221d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:06.931723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80743d58-560a-4d66-8b7a-78008cd9c3ef None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:06.964220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d305d5-990d-43d7-8f64-579deb9c221d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:06.972736 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf8aa1-bf2b-4bc8-86ec-4fdadb30972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:06.973806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8aa1-bf2b-4bc8-86ec-4fdadb30972a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.974243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8aa1-bf2b-4bc8-86ec-4fdadb30972a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.974723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8aa1-bf2b-4bc8-86ec-4fdadb30972a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.999133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf8aa1-bf2b-4bc8-86ec-4fdadb30972a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-fabf8aa1-bf2b-4bc8-86ec-4fdadb30972a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:07.007448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:07.008753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:08:07.009882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:07.013907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 377/724] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:07.020637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf8aa1-bf2b-4bc8-86ec-4fdadb30972a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:07.030925 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:07.048280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aef9b-4017-4017-99b7-660d8f1e1a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:07.049101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aef9b-4017-4017-99b7-660d8f1e1a09 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:07.049382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aef9b-4017-4017-99b7-660d8f1e1a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:07.049653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aef9b-4017-4017-99b7-660d8f1e1a09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:07.069998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331aef9b-4017-4017-99b7-660d8f1e1a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:07.070885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-331aef9b-4017-4017-99b7-660d8f1e1a09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:07.078359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:07.079389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:07.080355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:07.091854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 348/725] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:07.097431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aef9b-4017-4017-99b7-660d8f1e1a09 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:07.159980 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf8aa1-bf2b-4bc8-86ec-4fdadb30972a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:07.204545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd604a0a-0ed7-4b0d-bb57-30011a05f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:07.205578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd604a0a-0ed7-4b0d-bb57-30011a05f365 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:07.206103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd604a0a-0ed7-4b0d-bb57-30011a05f365 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:07.206605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd604a0a-0ed7-4b0d-bb57-30011a05f365 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:07.207566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd604a0a-0ed7-4b0d-bb57-30011a05f365 None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:07.208076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd604a0a-0ed7-4b0d-bb57-30011a05f365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:07.209687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd604a0a-0ed7-4b0d-bb57-30011a05f365 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:07.221274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 378/726] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:08:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:07.227009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd604a0a-0ed7-4b0d-bb57-30011a05f365 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:07.338039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:07.350235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd604a0a-0ed7-4b0d-bb57-30011a05f365 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:07.397750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aef9b-4017-4017-99b7-660d8f1e1a09 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:07.397955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f6046-8322-4751-9907-31aa4b883c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:07.398613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f6046-8322-4751-9907-31aa4b883c6c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:07.398903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f6046-8322-4751-9907-31aa4b883c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:07.399179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f6046-8322-4751-9907-31aa4b883c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:07.425944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f6046-8322-4751-9907-31aa4b883c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:07.427469 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f6046-8322-4751-9907-31aa4b883c6c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-388f6046-8322-4751-9907-31aa4b883c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:07.457665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:07.458642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:07.459580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:07.459580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:07.459580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:07.459580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:07.460331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 379/727] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:07.464443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f6046-8322-4751-9907-31aa4b883c6c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:07.480668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d465478-d28d-4e2f-a77d-4323e4cdc781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:07.481523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465478-d28d-4e2f-a77d-4323e4cdc781 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:07.481800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465478-d28d-4e2f-a77d-4323e4cdc781 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:07.482066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465478-d28d-4e2f-a77d-4323e4cdc781 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:07.482849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d465478-d28d-4e2f-a77d-4323e4cdc781 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:07.483151 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d465478-d28d-4e2f-a77d-4323e4cdc781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:07.484627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d465478-d28d-4e2f-a77d-4323e4cdc781 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:07.499690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 349/728] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:07.505597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d465478-d28d-4e2f-a77d-4323e4cdc781 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:07.601695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f6046-8322-4751-9907-31aa4b883c6c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:07.602874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:07.643002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee7eb8-828e-42ae-97f7-8f0c0e216656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:07.649426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee7eb8-828e-42ae-97f7-8f0c0e216656 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:07.649802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee7eb8-828e-42ae-97f7-8f0c0e216656 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:07.650692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee7eb8-828e-42ae-97f7-8f0c0e216656 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:07.654555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee7eb8-828e-42ae-97f7-8f0c0e216656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:07.654555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee7eb8-828e-42ae-97f7-8f0c0e216656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:07.654555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee7eb8-828e-42ae-97f7-8f0c0e216656 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:07.678536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 380/729] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:07.681168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee7eb8-828e-42ae-97f7-8f0c0e216656 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:07.694127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:07.705047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d465478-d28d-4e2f-a77d-4323e4cdc781 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:07.769214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68a5ca-9532-496b-a7cf-cb2a31d1a95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:07.769974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68a5ca-9532-496b-a7cf-cb2a31d1a95a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:07.770221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68a5ca-9532-496b-a7cf-cb2a31d1a95a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:07.770494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68a5ca-9532-496b-a7cf-cb2a31d1a95a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:07.784662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68a5ca-9532-496b-a7cf-cb2a31d1a95a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:07.786475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68a5ca-9532-496b-a7cf-cb2a31d1a95a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-fe68a5ca-9532-496b-a7cf-cb2a31d1a95a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:07.805120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:07.806096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:07.807021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:07.807021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:07.807021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:07.807021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:07.809365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 350/730] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:07.815445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68a5ca-9532-496b-a7cf-cb2a31d1a95a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:07.876649 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee7eb8-828e-42ae-97f7-8f0c0e216656 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:07.940206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100b886-6824-4e80-8619-26fa2ceac011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:07.941053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100b886-6824-4e80-8619-26fa2ceac011 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:07.941340 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100b886-6824-4e80-8619-26fa2ceac011 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:07.941618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100b886-6824-4e80-8619-26fa2ceac011 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:07.958014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100b886-6824-4e80-8619-26fa2ceac011 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:07.959559 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100b886-6824-4e80-8619-26fa2ceac011 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:07.964714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:07.968324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68a5ca-9532-496b-a7cf-cb2a31d1a95a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-0100b886-6824-4e80-8619-26fa2ceac011 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:07.989121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:07.990154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:07.991151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:07.991151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:07.991151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:07.991151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:07.991151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:07.991151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:07.991151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:07.991151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:07.991151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:07.991151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:07.998096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 381/731] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 10:08:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:07.999039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100b886-6824-4e80-8619-26fa2ceac011 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:08.037863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46c60d-2f05-40f0-9f0e-a0b30b2bfedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:08.038466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46c60d-2f05-40f0-9f0e-a0b30b2bfedd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.038778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46c60d-2f05-40f0-9f0e-a0b30b2bfedd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.039053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46c60d-2f05-40f0-9f0e-a0b30b2bfedd None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.039795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46c60d-2f05-40f0-9f0e-a0b30b2bfedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:08.040102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46c60d-2f05-40f0-9f0e-a0b30b2bfedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:08.041517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46c60d-2f05-40f0-9f0e-a0b30b2bfedd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:08.054967 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 351/732] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:08.060681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46c60d-2f05-40f0-9f0e-a0b30b2bfedd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:08.173688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:08.207964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46c60d-2f05-40f0-9f0e-a0b30b2bfedd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:08.254643 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100b886-6824-4e80-8619-26fa2ceac011 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:08.285860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9b47d-11af-4492-ac5d-35d009e725c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:08.286718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9b47d-11af-4492-ac5d-35d009e725c9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.287003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9b47d-11af-4492-ac5d-35d009e725c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.287281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9b47d-11af-4492-ac5d-35d009e725c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.305848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9b47d-11af-4492-ac5d-35d009e725c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:08.307265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9b47d-11af-4492-ac5d-35d009e725c9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-abb9b47d-11af-4492-ac5d-35d009e725c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:08.335275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:08.336325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:08.337371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:08.337371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:08.337371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:08.337371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:08.337371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:08.337371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:08.337371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:08.337371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:08.337371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:08:08.337371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:08.337917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1d3f-5ac8-42c1-aee1-95ac137f8de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:08.338011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1d3f-5ac8-42c1-aee1-95ac137f8de3 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.338625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1d3f-5ac8-42c1-aee1-95ac137f8de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.338625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1d3f-5ac8-42c1-aee1-95ac137f8de3 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.343459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1d3f-5ac8-42c1-aee1-95ac137f8de3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:08.343781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1d3f-5ac8-42c1-aee1-95ac137f8de3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:08.345261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1d3f-5ac8-42c1-aee1-95ac137f8de3 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:08.352832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 352/733] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:08.357943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9b47d-11af-4492-ac5d-35d009e725c9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:08.379880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 382/734] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 10:08:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:08.385557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1d3f-5ac8-42c1-aee1-95ac137f8de3 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:08.402949 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:08.515447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1d3f-5ac8-42c1-aee1-95ac137f8de3 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:08.552232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aae35-3920-4579-9c7f-6bb31f37266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:08.552999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aae35-3920-4579-9c7f-6bb31f37266c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.553284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aae35-3920-4579-9c7f-6bb31f37266c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.553561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aae35-3920-4579-9c7f-6bb31f37266c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.554802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:08.593185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9b47d-11af-4492-ac5d-35d009e725c9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:08.630390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aae35-3920-4579-9c7f-6bb31f37266c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:08.632276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aae35-3920-4579-9c7f-6bb31f37266c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:08.683274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22053bde-5bc5-4a10-8bbd-f82c09671e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:08.684024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22053bde-5bc5-4a10-8bbd-f82c09671e37 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.684324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22053bde-5bc5-4a10-8bbd-f82c09671e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.684605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22053bde-5bc5-4a10-8bbd-f82c09671e37 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.685478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22053bde-5bc5-4a10-8bbd-f82c09671e37 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:08.685791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22053bde-5bc5-4a10-8bbd-f82c09671e37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:08.687291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22053bde-5bc5-4a10-8bbd-f82c09671e37 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:08.731075 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 353/735] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 10:08:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:08.737880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22053bde-5bc5-4a10-8bbd-f82c09671e37 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:08.748099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 383/736] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:08.752938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71321-8244-4825-8892-067c80b49663 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.753230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71321-8244-4825-8892-067c80b49663 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.753508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71321-8244-4825-8892-067c80b49663 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.755114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 384/737] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:08.755959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71321-8244-4825-8892-067c80b49663 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:08.782704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:08.845831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:08.869529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71321-8244-4825-8892-067c80b49663 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:08.869882 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22053bde-5bc5-4a10-8bbd-f82c09671e37 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:08.905385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a574ae2-ba57-4a98-9d51-a5ccb956ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:08.906194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a574ae2-ba57-4a98-9d51-a5ccb956ec29 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.906474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a574ae2-ba57-4a98-9d51-a5ccb956ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.906776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a574ae2-ba57-4a98-9d51-a5ccb956ec29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.918384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce3771-b3b8-4d68-a923-5fdb0e0330ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:08.919089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce3771-b3b8-4d68-a923-5fdb0e0330ce None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.919371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce3771-b3b8-4d68-a923-5fdb0e0330ce None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.919602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a574ae2-ba57-4a98-9d51-a5ccb956ec29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:08.919704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce3771-b3b8-4d68-a923-5fdb0e0330ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.921100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a574ae2-ba57-4a98-9d51-a5ccb956ec29 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-1a574ae2-ba57-4a98-9d51-a5ccb956ec29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:08.941247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:08.942215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:08.944009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:08.944009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:08.944009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:08.944009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:08.944009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 385/738] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:08.944009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8f279-175b-40a0-990d-027d9b71c7c8 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.944350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8f279-175b-40a0-990d-027d9b71c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.944350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8f279-175b-40a0-990d-027d9b71c7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.961221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-08d8f279-175b-40a0-990d-027d9b71c7c8 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:08.962585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-08d8f279-175b-40a0-990d-027d9b71c7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:08.998331 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce3771-b3b8-4d68-a923-5fdb0e0330ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:08.999952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce3771-b3b8-4d68-a923-5fdb0e0330ce None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:09.035549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 386/739] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:08:09.036715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9b5f-ebe8-4d67-8189-c9ab1009c8e7 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.037009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9b5f-ebe8-4d67-8189-c9ab1009c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.037285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9b5f-ebe8-4d67-8189-c9ab1009c8e7 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.038704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 387/740] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:09.043304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9b5f-ebe8-4d67-8189-c9ab1009c8e7 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:09.048808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:09.095550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:09.118679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 354/741] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:08:09.119983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee890c92-8771-4b09-b078-785407aeb362 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.120265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee890c92-8771-4b09-b078-785407aeb362 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.120535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee890c92-8771-4b09-b078-785407aeb362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.136880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ee890c92-8771-4b09-b078-785407aeb362 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:09.138079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ee890c92-8771-4b09-b078-785407aeb362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:09.155053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9b5f-ebe8-4d67-8189-c9ab1009c8e7 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:09.193145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd4c65-e95b-436e-9098-2d1320133887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:09.193863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd4c65-e95b-436e-9098-2d1320133887 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.194210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd4c65-e95b-436e-9098-2d1320133887 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.194488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd4c65-e95b-436e-9098-2d1320133887 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.195133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd4c65-e95b-436e-9098-2d1320133887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:09.195436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd4c65-e95b-436e-9098-2d1320133887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:09.199053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd4c65-e95b-436e-9098-2d1320133887 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:09.208595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 388/742] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:09.218725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 355/743] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:08:09.218929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd4c65-e95b-436e-9098-2d1320133887 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:09.219086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fd7c8-64ff-4186-b342-7d60761d99d6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.219086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fd7c8-64ff-4186-b342-7d60761d99d6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.219086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fd7c8-64ff-4186-b342-7d60761d99d6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.219086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 356/744] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:09.219086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fd7c8-64ff-4186-b342-7d60761d99d6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:09.292984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:09.321309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fd7c8-64ff-4186-b342-7d60761d99d6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:09.330654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:09.333941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd4c65-e95b-436e-9098-2d1320133887 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:09.358436 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2ac6f-4eda-4bb5-98ee-c721201c7392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:09.359270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2ac6f-4eda-4bb5-98ee-c721201c7392 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.359567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2ac6f-4eda-4bb5-98ee-c721201c7392 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.359841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2ac6f-4eda-4bb5-98ee-c721201c7392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.367422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329c34-5994-4357-a014-f57c225b1b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:09.368101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329c34-5994-4357-a014-f57c225b1b0a None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.368382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329c34-5994-4357-a014-f57c225b1b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.368657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329c34-5994-4357-a014-f57c225b1b0a None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.369452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc329c34-5994-4357-a014-f57c225b1b0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:09.370067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2ac6f-4eda-4bb5-98ee-c721201c7392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:09.370796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc329c34-5994-4357-a014-f57c225b1b0a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:09.371606 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2ac6f-4eda-4bb5-98ee-c721201c7392 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:09.385242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 389/745] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:08:09 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:09.386357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329c34-5994-4357-a014-f57c225b1b0a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-11d2ac6f-4eda-4bb5-98ee-c721201c7392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:09.390445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:09.391473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:09.392464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:09.392464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:09.392464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:09.392464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:09.392464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 357/746] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:09.393210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5481-35c7-4567-a3a6-6fe08731709e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.393500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5481-35c7-4567-a3a6-6fe08731709e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.393776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5481-35c7-4567-a3a6-6fe08731709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.424656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-db3b5481-35c7-4567-a3a6-6fe08731709e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:09.425990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-db3b5481-35c7-4567-a3a6-6fe08731709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:09.534531 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 358/747] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:08:09.534748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329c34-5994-4357-a014-f57c225b1b0a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:09.534840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5481-35c7-4567-a3a6-6fe08731709e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:09.552458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:09.570955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e464ec-dc11-44f5-a197-1827b7e9c884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:09.571995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e464ec-dc11-44f5-a197-1827b7e9c884 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.572223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e464ec-dc11-44f5-a197-1827b7e9c884 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.572321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e464ec-dc11-44f5-a197-1827b7e9c884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.580964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e464ec-dc11-44f5-a197-1827b7e9c884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:09.582272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e464ec-dc11-44f5-a197-1827b7e9c884 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-01e464ec-dc11-44f5-a197-1827b7e9c884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:09.598056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:09.599152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:09.600229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:09.600229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:09.600229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:09.600229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:09.600229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:09.600229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:09.600229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:09.600229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:09.600229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 390/748] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:09.600829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e464ec-dc11-44f5-a197-1827b7e9c884 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:09.644250 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:09.663532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5481-35c7-4567-a3a6-6fe08731709e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:09.698389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98453-0f2f-4991-9b7f-510c53ba80ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:09.699102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98453-0f2f-4991-9b7f-510c53ba80ef None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.699387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98453-0f2f-4991-9b7f-510c53ba80ef None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.699714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98453-0f2f-4991-9b7f-510c53ba80ef None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.700450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df98453-0f2f-4991-9b7f-510c53ba80ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:09.701852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df98453-0f2f-4991-9b7f-510c53ba80ef None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:09.717895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 359/749] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:08:09 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:09.718760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98453-0f2f-4991-9b7f-510c53ba80ef None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:09.720078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e464ec-dc11-44f5-a197-1827b7e9c884 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:09.782395 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea182-4dd0-42f9-85d1-12711342d7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:09.784135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea182-4dd0-42f9-85d1-12711342d7cc None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.784657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea182-4dd0-42f9-85d1-12711342d7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.785205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea182-4dd0-42f9-85d1-12711342d7cc None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.786557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceea182-4dd0-42f9-85d1-12711342d7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:09.787087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceea182-4dd0-42f9-85d1-12711342d7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:09.789224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceea182-4dd0-42f9-85d1-12711342d7cc None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:09.814181 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 391/750] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:09.814181 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea182-4dd0-42f9-85d1-12711342d7cc None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:09.862825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:09.864298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98453-0f2f-4991-9b7f-510c53ba80ef None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:09.905887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24e3cb-a635-426f-be4b-6ce6eb6619d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:09.906693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e3cb-a635-426f-be4b-6ce6eb6619d3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.906970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e3cb-a635-426f-be4b-6ce6eb6619d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.907237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e3cb-a635-426f-be4b-6ce6eb6619d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.919748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24e3cb-a635-426f-be4b-6ce6eb6619d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-bb24e3cb-a635-426f-be4b-6ce6eb6619d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:09.928001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:09.928979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:09.929839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 360/751] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:09.930654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24e3cb-a635-426f-be4b-6ce6eb6619d3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:09.942351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:09.944600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea182-4dd0-42f9-85d1-12711342d7cc None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:09.987237 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9d950-7662-4012-be4d-7132c4742990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:09.988636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9d950-7662-4012-be4d-7132c4742990 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.989406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9d950-7662-4012-be4d-7132c4742990 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.989887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9d950-7662-4012-be4d-7132c4742990 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.991072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9d950-7662-4012-be4d-7132c4742990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:09.991979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9d950-7662-4012-be4d-7132c4742990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:09.994083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9d950-7662-4012-be4d-7132c4742990 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:10.009982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 392/752] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:10.011708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9d950-7662-4012-be4d-7132c4742990 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:10.052132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24e3cb-a635-426f-be4b-6ce6eb6619d3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:10.112286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafbf74-a836-47d7-81fc-8d576203abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:10.113757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafbf74-a836-47d7-81fc-8d576203abb8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:10.114236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafbf74-a836-47d7-81fc-8d576203abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:10.114757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafbf74-a836-47d7-81fc-8d576203abb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:10.128207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafbf74-a836-47d7-81fc-8d576203abb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:10.131326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafbf74-a836-47d7-81fc-8d576203abb8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:10.141436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9d950-7662-4012-be4d-7132c4742990 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:10.158967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-2dafbf74-a836-47d7-81fc-8d576203abb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:10.159424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:10.160347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:10.161292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:10.161292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:10.161292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:10.161292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:10.161292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:10.161292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:10.161292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:10.161292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:10.169931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 361/753] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:10.171732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafbf74-a836-47d7-81fc-8d576203abb8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:10.187759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705a52-f448-495c-b044-037753a6731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:10.188802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705a52-f448-495c-b044-037753a6731f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:10.189269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705a52-f448-495c-b044-037753a6731f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:10.189944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705a52-f448-495c-b044-037753a6731f None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:10.191160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0705a52-f448-495c-b044-037753a6731f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:10.191664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0705a52-f448-495c-b044-037753a6731f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:10.194249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0705a52-f448-495c-b044-037753a6731f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:10.218361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 393/754] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:08:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:10.218361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705a52-f448-495c-b044-037753a6731f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:10.265441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:10.322561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafbf74-a836-47d7-81fc-8d576203abb8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:10.342916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705a52-f448-495c-b044-037753a6731f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:10.359798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b771694-9521-458d-be19-134e43daa818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:10.360495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b771694-9521-458d-be19-134e43daa818 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:10.360785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b771694-9521-458d-be19-134e43daa818 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:10.361062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b771694-9521-458d-be19-134e43daa818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:10.361906 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b771694-9521-458d-be19-134e43daa818 None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=7701ac0e772842e29e9e6903ff551a13) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:10.362382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b771694-9521-458d-be19-134e43daa818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:10.363864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b771694-9521-458d-be19-134e43daa818 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:10.370364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 362/755] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:10 2022] GET /identity/v3/role_assignments?user.id=7701ac0e772842e29e9e6903ff551a13&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:10.371382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b771694-9521-458d-be19-134e43daa818 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:10.392443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da603f2d-54f0-4bb5-8ffd-45cbee9d67da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:10.393958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da603f2d-54f0-4bb5-8ffd-45cbee9d67da None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:10.394446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da603f2d-54f0-4bb5-8ffd-45cbee9d67da None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:10.394936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da603f2d-54f0-4bb5-8ffd-45cbee9d67da None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:10.395981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da603f2d-54f0-4bb5-8ffd-45cbee9d67da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:10.396507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da603f2d-54f0-4bb5-8ffd-45cbee9d67da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:10.399539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da603f2d-54f0-4bb5-8ffd-45cbee9d67da None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:10.422771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 394/756] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:10.425789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da603f2d-54f0-4bb5-8ffd-45cbee9d67da None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:10.452608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:10.499204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b771694-9521-458d-be19-134e43daa818 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:10.553844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da603f2d-54f0-4bb5-8ffd-45cbee9d67da None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:10.584825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:10.599135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffc37f-5dc1-497d-b372-d2f748fc2b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:10.601347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffc37f-5dc1-497d-b372-d2f748fc2b4b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:10.601347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffc37f-5dc1-497d-b372-d2f748fc2b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:10.601347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffc37f-5dc1-497d-b372-d2f748fc2b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:10.604086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b45c9e-bf79-48ef-848e-42ed0f7e8b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:10.605478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45c9e-bf79-48ef-848e-42ed0f7e8b35 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:10.606036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45c9e-bf79-48ef-848e-42ed0f7e8b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:10.606546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45c9e-bf79-48ef-848e-42ed0f7e8b35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:10.608318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b45c9e-bf79-48ef-848e-42ed0f7e8b35 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=b0c07436108d4a2089a74e7891b849c5) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:10.608884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b45c9e-bf79-48ef-848e-42ed0f7e8b35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:10.610605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b45c9e-bf79-48ef-848e-42ed0f7e8b35 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:10.617919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffc37f-5dc1-497d-b372-d2f748fc2b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:10.619251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 395/757] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:10 2022] GET /identity/v3/role_assignments?user.id=b0c07436108d4a2089a74e7891b849c5&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:10.620079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffc37f-5dc1-497d-b372-d2f748fc2b4b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a7ffc37f-5dc1-497d-b372-d2f748fc2b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:10.641382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:10.642366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:10.643347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:10.643347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:10.643347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:10.643347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:10.650931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 363/758] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:10.652301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b45c9e-bf79-48ef-848e-42ed0f7e8b35 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:10.773761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:10.803126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b45c9e-bf79-48ef-848e-42ed0f7e8b35 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:10.845528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd403e-b053-46c9-9c6e-73a66957a060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:10.846262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd403e-b053-46c9-9c6e-73a66957a060 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:10.846580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd403e-b053-46c9-9c6e-73a66957a060 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:10.846904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd403e-b053-46c9-9c6e-73a66957a060 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:10.847651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd403e-b053-46c9-9c6e-73a66957a060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:10.847966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd403e-b053-46c9-9c6e-73a66957a060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:10.849361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd403e-b053-46c9-9c6e-73a66957a060 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:10.862774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 396/759] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:10.868610 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffc37f-5dc1-497d-b372-d2f748fc2b4b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:10.978025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffc37f-5dc1-497d-b372-d2f748fc2b4b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:11.017999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2558b-b54d-4329-873e-82c640c8e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:11.018866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2558b-b54d-4329-873e-82c640c8e04d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:11.019153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2558b-b54d-4329-873e-82c640c8e04d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:11.019430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2558b-b54d-4329-873e-82c640c8e04d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:11.028010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2558b-b54d-4329-873e-82c640c8e04d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:11.029409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2558b-b54d-4329-873e-82c640c8e04d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-02a2558b-b54d-4329-873e-82c640c8e04d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:11.045643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:11.047929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:11.050171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 364/760] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 10:08:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:11.055891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd403e-b053-46c9-9c6e-73a66957a060 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:11.181072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd403e-b053-46c9-9c6e-73a66957a060 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:11.224302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcd0fd-3db4-4612-8ce7-abc84dc909ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:11.224996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcd0fd-3db4-4612-8ce7-abc84dc909ad None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:11.225276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcd0fd-3db4-4612-8ce7-abc84dc909ad None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:11.225555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcd0fd-3db4-4612-8ce7-abc84dc909ad None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:11.226403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcd0fd-3db4-4612-8ce7-abc84dc909ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:11.226739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcd0fd-3db4-4612-8ce7-abc84dc909ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:11.228306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcd0fd-3db4-4612-8ce7-abc84dc909ad None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:11.256208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 397/761] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 10:08:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:11.261844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2558b-b54d-4329-873e-82c640c8e04d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:11.315463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:11.375684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2558b-b54d-4329-873e-82c640c8e04d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:11.422091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36360a3-e762-4f37-abc7-385052b25914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:11.422946 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36360a3-e762-4f37-abc7-385052b25914 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:11.423232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36360a3-e762-4f37-abc7-385052b25914 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:11.423502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36360a3-e762-4f37-abc7-385052b25914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:11.439216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36360a3-e762-4f37-abc7-385052b25914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:11.440705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36360a3-e762-4f37-abc7-385052b25914 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b36360a3-e762-4f37-abc7-385052b25914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:11.470878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:11.471881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:11.472787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:11.472787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:11.472787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:11.472787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:11.472787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 365/762] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:11.478065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcd0fd-3db4-4612-8ce7-abc84dc909ad None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:11.482926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:11.644942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcd0fd-3db4-4612-8ce7-abc84dc909ad None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:11.686470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ab28-6116-412d-9023-8194f40f8e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:11.687188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ab28-6116-412d-9023-8194f40f8e37 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:11.687467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ab28-6116-412d-9023-8194f40f8e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:11.687745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ab28-6116-412d-9023-8194f40f8e37 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:11.688473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712ab28-6116-412d-9023-8194f40f8e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:11.688774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712ab28-6116-412d-9023-8194f40f8e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:11.690209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712ab28-6116-412d-9023-8194f40f8e37 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:11.703078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 398/763] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:11.708621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36360a3-e762-4f37-abc7-385052b25914 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:11.766832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44b5b-ee94-4198-b136-5c4d0da488c4 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:11.767180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44b5b-ee94-4198-b136-5c4d0da488c4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:11.767463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44b5b-ee94-4198-b136-5c4d0da488c4 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:11.769181 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 399/764] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:11.774645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fae4d-13a7-46f0-b809-894554b31941 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:11.775292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fae4d-13a7-46f0-b809-894554b31941 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:11.775292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fae4d-13a7-46f0-b809-894554b31941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:11.797266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-117fae4d-13a7-46f0-b809-894554b31941 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:11.798473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-117fae4d-13a7-46f0-b809-894554b31941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:11.852968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:11.869418 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36360a3-e762-4f37-abc7-385052b25914 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:11.895747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:11.902401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 400/765] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:11.930253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fae4d-13a7-46f0-b809-894554b31941 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:11.973056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04cc0f-4e8a-4d6d-b290-2d6d522aa109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:11.974213 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04cc0f-4e8a-4d6d-b290-2d6d522aa109 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:11.974672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04cc0f-4e8a-4d6d-b290-2d6d522aa109 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:11.975083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04cc0f-4e8a-4d6d-b290-2d6d522aa109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:11.986410 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04cc0f-4e8a-4d6d-b290-2d6d522aa109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:11.989340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04cc0f-4e8a-4d6d-b290-2d6d522aa109 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-bb04cc0f-4e8a-4d6d-b290-2d6d522aa109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:12.011665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:12.012858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:12.013975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:12.013975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:12.013975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:12.013975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:12.013975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:12.013975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:12.013975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:12.013975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:12.024975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 366/766] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:12.029405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04cc0f-4e8a-4d6d-b290-2d6d522aa109 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:12.127582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fae4d-13a7-46f0-b809-894554b31941 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:12.177732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb17f2-bf15-4970-a74d-3336f74cdbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:12.178927 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb17f2-bf15-4970-a74d-3336f74cdbcd None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:12.179347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb17f2-bf15-4970-a74d-3336f74cdbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:12.179859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb17f2-bf15-4970-a74d-3336f74cdbcd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:12.180787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb17f2-bf15-4970-a74d-3336f74cdbcd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:12.182305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb17f2-bf15-4970-a74d-3336f74cdbcd None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-cddb17f2-bf15-4970-a74d-3336f74cdbcd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:12.195483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:12.196530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:08:12.197494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:12.198402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04cc0f-4e8a-4d6d-b290-2d6d522aa109 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:12.200124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 401/767] 10.222.0.66 () {56 vars in 1129 bytes} [Wed Jun 22 10:08:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:12.201532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f63d6-f013-497e-b911-7b444417bab5 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:12.201975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f63d6-f013-497e-b911-7b444417bab5 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:12.202422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f63d6-f013-497e-b911-7b444417bab5 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:12.204098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 402/768] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:12.212237 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f63d6-f013-497e-b911-7b444417bab5 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:12.243218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf22ff-0243-46d1-8d50-e65686b881b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:12.243890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf22ff-0243-46d1-8d50-e65686b881b0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:12.244434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf22ff-0243-46d1-8d50-e65686b881b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:12.244957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf22ff-0243-46d1-8d50-e65686b881b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:12.245912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf22ff-0243-46d1-8d50-e65686b881b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:12.246222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf22ff-0243-46d1-8d50-e65686b881b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:12.248269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf22ff-0243-46d1-8d50-e65686b881b0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:12.264556 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 367/769] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:12.271069 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9b206-eb0f-4de9-8347-9d86f0ac7c67 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:12.271578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9b206-eb0f-4de9-8347-9d86f0ac7c67 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:12.272078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9b206-eb0f-4de9-8347-9d86f0ac7c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:12.284462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:12.294859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fbf9b206-eb0f-4de9-8347-9d86f0ac7c67 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:12.296541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fbf9b206-eb0f-4de9-8347-9d86f0ac7c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:12.307580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:12.347209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f63d6-f013-497e-b911-7b444417bab5 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:12.384796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 368/770] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:12.386007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9b206-eb0f-4de9-8347-9d86f0ac7c67 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:12.393853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e23c-9ee2-44d5-8f61-c6824afb54eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:12.394825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e23c-9ee2-44d5-8f61-c6824afb54eb None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:12.395391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e23c-9ee2-44d5-8f61-c6824afb54eb None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:12.395843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e23c-9ee2-44d5-8f61-c6824afb54eb None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:12.396737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53e23c-9ee2-44d5-8f61-c6824afb54eb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:12.397216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53e23c-9ee2-44d5-8f61-c6824afb54eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:12.398943 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53e23c-9ee2-44d5-8f61-c6824afb54eb None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:12.412896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 403/771] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 10:08:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:12.419176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e23c-9ee2-44d5-8f61-c6824afb54eb None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:12.517545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9b206-eb0f-4de9-8347-9d86f0ac7c67 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:12.548240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e23c-9ee2-44d5-8f61-c6824afb54eb None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:12.569567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba158b-3a21-4f77-9766-7abb2f82beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:12.570632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba158b-3a21-4f77-9766-7abb2f82beb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:12.570978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba158b-3a21-4f77-9766-7abb2f82beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:12.571320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba158b-3a21-4f77-9766-7abb2f82beb6 None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/f91c2e9ae8844d9181aff785c02cf3be/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:12.574154 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba158b-3a21-4f77-9766-7abb2f82beb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=f91c2e9ae8844d9181aff785c02cf3be, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:12.576213 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba158b-3a21-4f77-9766-7abb2f82beb6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:12.577836 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:12.602579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 369/772] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:08:12 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/f91c2e9ae8844d9181aff785c02cf3be/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:08:12.602579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba158b-3a21-4f77-9766-7abb2f82beb6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:12.602579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:12.607122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a453d4-703b-4557-9567-3acc0024e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:12.608436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a453d4-703b-4557-9567-3acc0024e35a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:12.609214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a453d4-703b-4557-9567-3acc0024e35a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:12.609700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a453d4-703b-4557-9567-3acc0024e35a None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:12.611035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a453d4-703b-4557-9567-3acc0024e35a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:12.615039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a453d4-703b-4557-9567-3acc0024e35a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:12.616541 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a453d4-703b-4557-9567-3acc0024e35a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:12.653091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 404/773] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 10:08:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:12.663306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a453d4-703b-4557-9567-3acc0024e35a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:12.754916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba158b-3a21-4f77-9766-7abb2f82beb6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:12.799097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495cf01-9a1e-4ffa-9a50-2c9a8af88d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:12.800080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495cf01-9a1e-4ffa-9a50-2c9a8af88d0e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:12.800374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495cf01-9a1e-4ffa-9a50-2c9a8af88d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:12.800653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495cf01-9a1e-4ffa-9a50-2c9a8af88d0e None admin] PATH_INFO: `/v3/services/network` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:12.801352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495cf01-9a1e-4ffa-9a50-2c9a8af88d0e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:12.804297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495cf01-9a1e-4ffa-9a50-2c9a8af88d0e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3495cf01-9a1e-4ffa-9a50-2c9a8af88d0e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:12.819334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:12.820385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:12.821236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 370/774] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:12 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:12.828947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495cf01-9a1e-4ffa-9a50-2c9a8af88d0e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:12.873234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a453d4-703b-4557-9567-3acc0024e35a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:12.915904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:12.921393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b283e9-da65-4287-b1f0-6dd551ddd741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:12.922442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b283e9-da65-4287-b1f0-6dd551ddd741 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:12.922943 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b283e9-da65-4287-b1f0-6dd551ddd741 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:12.923432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b283e9-da65-4287-b1f0-6dd551ddd741 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:12.924444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b283e9-da65-4287-b1f0-6dd551ddd741 None admin] RBAC: Adding query filter params (interface=public, service_id=191e79b26fe0425689208879f69927bd, region_id=RegionOne) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:12.924954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b283e9-da65-4287-b1f0-6dd551ddd741 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:12.926860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b283e9-da65-4287-b1f0-6dd551ddd741 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:12.938090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 405/775] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 10:08:12 2022] GET /identity/v3/endpoints?service_id=191e79b26fe0425689208879f69927bd&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:12.950773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b283e9-da65-4287-b1f0-6dd551ddd741 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:12.960893 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495cf01-9a1e-4ffa-9a50-2c9a8af88d0e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:13.002902 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b045c3-2fbb-4c46-a5c0-b30310086668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:13.003576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b045c3-2fbb-4c46-a5c0-b30310086668 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.003859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b045c3-2fbb-4c46-a5c0-b30310086668 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.004133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b045c3-2fbb-4c46-a5c0-b30310086668 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.005798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b045c3-2fbb-4c46-a5c0-b30310086668 None admin] RBAC: Adding query filter params (name=network) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:13.006121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b045c3-2fbb-4c46-a5c0-b30310086668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:13.007565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b045c3-2fbb-4c46-a5c0-b30310086668 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:13.014026 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 371/776] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:13.015384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b04e2f-d2fb-4aa5-8f14-e0ae129726ad None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.015670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b04e2f-d2fb-4aa5-8f14-e0ae129726ad None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.015946 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b04e2f-d2fb-4aa5-8f14-e0ae129726ad None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.017457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 372/777] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:13.022565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b04e2f-d2fb-4aa5-8f14-e0ae129726ad None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:13.063376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:13.094832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b283e9-da65-4287-b1f0-6dd551ddd741 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:13.134726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8f131-5693-4f2b-a665-c5c2dc5f43b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:13.136094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8f131-5693-4f2b-a665-c5c2dc5f43b3 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.136575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8f131-5693-4f2b-a665-c5c2dc5f43b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.137227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8f131-5693-4f2b-a665-c5c2dc5f43b3 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.138624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8f131-5693-4f2b-a665-c5c2dc5f43b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:13.140479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8f131-5693-4f2b-a665-c5c2dc5f43b3 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:13.148503 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 406/778] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 10:08:12 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:13.150047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fcc4a-af55-4d73-9db2-c821c087450d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.150557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fcc4a-af55-4d73-9db2-c821c087450d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.151070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fcc4a-af55-4d73-9db2-c821c087450d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.163320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b04e2f-d2fb-4aa5-8f14-e0ae129726ad None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:13.192485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-4a2fcc4a-af55-4d73-9db2-c821c087450d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:13.196225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4a2fcc4a-af55-4d73-9db2-c821c087450d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:13.251854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:13.267014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f290953-7946-43b4-8855-c196a64cc391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:13.267900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f290953-7946-43b4-8855-c196a64cc391 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.268179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f290953-7946-43b4-8855-c196a64cc391 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.268449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f290953-7946-43b4-8855-c196a64cc391 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.270751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f290953-7946-43b4-8855-c196a64cc391 None admin] RBAC: Adding query filter params (type=network) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:13.271071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f290953-7946-43b4-8855-c196a64cc391 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:13.273296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f290953-7946-43b4-8855-c196a64cc391 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:13.288221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 373/779] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:13.295017 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f290953-7946-43b4-8855-c196a64cc391 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:13.339602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 407/780] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:13.365185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fcc4a-af55-4d73-9db2-c821c087450d None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:13.421870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:13.445489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f290953-7946-43b4-8855-c196a64cc391 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:13.478486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fcc4a-af55-4d73-9db2-c821c087450d None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:13.505335 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb48291-344f-4113-95bc-844c23a73006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:13.507035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48291-344f-4113-95bc-844c23a73006 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.507802 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48291-344f-4113-95bc-844c23a73006 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.508281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48291-344f-4113-95bc-844c23a73006 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.510010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb48291-344f-4113-95bc-844c23a73006 None admin] RBAC: Adding query filter params (interface=public, service_id=e33ef2d288ba4a77ab5cdcca83d2d1e5, region_id=RegionOne) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:13.510568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb48291-344f-4113-95bc-844c23a73006 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:13.512738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb48291-344f-4113-95bc-844c23a73006 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:13.521814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb57d04-9ecd-4da7-9675-010c1473aef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:13.522670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57d04-9ecd-4da7-9675-010c1473aef9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.522952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57d04-9ecd-4da7-9675-010c1473aef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.523228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57d04-9ecd-4da7-9675-010c1473aef9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.524230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 374/781] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 10:08:13 2022] GET /identity/v3/endpoints?service_id=e33ef2d288ba4a77ab5cdcca83d2d1e5&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:13.525793 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54707400-a5ec-4350-8195-c9db98596715 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.526286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54707400-a5ec-4350-8195-c9db98596715 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.526783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54707400-a5ec-4350-8195-c9db98596715 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.528741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 375/782] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:13.533522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54707400-a5ec-4350-8195-c9db98596715 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:13.545526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb57d04-9ecd-4da7-9675-010c1473aef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-3cb57d04-9ecd-4da7-9675-010c1473aef9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:13.555560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:13.556576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:13.557425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 408/783] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:08:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:13.558651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67651cc-7957-4d68-b535-aa385fbcbb05 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.558959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67651cc-7957-4d68-b535-aa385fbcbb05 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.559306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67651cc-7957-4d68-b535-aa385fbcbb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.583574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e67651cc-7957-4d68-b535-aa385fbcbb05 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:13.584781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e67651cc-7957-4d68-b535-aa385fbcbb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:13.614332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:13.686863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54707400-a5ec-4350-8195-c9db98596715 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:13.693718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 409/784] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:13.694864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67651cc-7957-4d68-b535-aa385fbcbb05 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:13.735573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:13.757295 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06274cb1-b408-409d-8a71-dea8b0f2217e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:13.758155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06274cb1-b408-409d-8a71-dea8b0f2217e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.758822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06274cb1-b408-409d-8a71-dea8b0f2217e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.759197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06274cb1-b408-409d-8a71-dea8b0f2217e None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.759981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06274cb1-b408-409d-8a71-dea8b0f2217e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:13.762456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06274cb1-b408-409d-8a71-dea8b0f2217e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:13.777728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 376/785] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 10:08:13 2022] GET /identity/v3/services => generated 772 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:13.777728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06274cb1-b408-409d-8a71-dea8b0f2217e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:13.853527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67651cc-7957-4d68-b535-aa385fbcbb05 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:13.900169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06274cb1-b408-409d-8a71-dea8b0f2217e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:13.932667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:13.948676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48498c63-cdd4-4e19-b21f-b1420f868091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:13.951134 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48498c63-cdd4-4e19-b21f-b1420f868091 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.952097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90160d08-04e6-49f4-a419-6e4c7fb7d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:13.953203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90160d08-04e6-49f4-a419-6e4c7fb7d339 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.953741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48498c63-cdd4-4e19-b21f-b1420f868091 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.954227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48498c63-cdd4-4e19-b21f-b1420f868091 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.955401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48498c63-cdd4-4e19-b21f-b1420f868091 None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:13.955840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90160d08-04e6-49f4-a419-6e4c7fb7d339 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.956310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90160d08-04e6-49f4-a419-6e4c7fb7d339 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.957514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48498c63-cdd4-4e19-b21f-b1420f868091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:13.959482 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48498c63-cdd4-4e19-b21f-b1420f868091 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:13.983032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 410/786] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:08:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:13.984591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90160d08-04e6-49f4-a419-6e4c7fb7d339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-90160d08-04e6-49f4-a419-6e4c7fb7d339 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:13.992976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:13.994015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:13.994897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:13.997214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48498c63-cdd4-4e19-b21f-b1420f868091 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:14.008666 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 377/787] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:14.022129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90160d08-04e6-49f4-a419-6e4c7fb7d339 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:14.150771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:14.164156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48498c63-cdd4-4e19-b21f-b1420f868091 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:14.185659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90160d08-04e6-49f4-a419-6e4c7fb7d339 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:14.210562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0cb1f-2b78-42bd-bdfe-8ba61fe0e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:14.210562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0cb1f-2b78-42bd-bdfe-8ba61fe0e727 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:14.210562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0cb1f-2b78-42bd-bdfe-8ba61fe0e727 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:14.210562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0cb1f-2b78-42bd-bdfe-8ba61fe0e727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:14.216355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0cb1f-2b78-42bd-bdfe-8ba61fe0e727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:14.217830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0cb1f-2b78-42bd-bdfe-8ba61fe0e727 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-d1e0cb1f-2b78-42bd-bdfe-8ba61fe0e727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:14.236316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:14.237484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:14.238691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:14.238691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:14.238691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:14.238691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:14.238691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 411/788] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:14.242443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0cb1f-2b78-42bd-bdfe-8ba61fe0e727 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:14.248635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e14071-238f-4776-8ae3-edf0d69fd81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:14.249458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e14071-238f-4776-8ae3-edf0d69fd81a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:14.249840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e14071-238f-4776-8ae3-edf0d69fd81a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:14.250214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e14071-238f-4776-8ae3-edf0d69fd81a None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:14.251106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e14071-238f-4776-8ae3-edf0d69fd81a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:14.256934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e14071-238f-4776-8ae3-edf0d69fd81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:14.258377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e14071-238f-4776-8ae3-edf0d69fd81a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:14.273909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 378/789] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:14.279824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e14071-238f-4776-8ae3-edf0d69fd81a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:14.370091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:14.391819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0cb1f-2b78-42bd-bdfe-8ba61fe0e727 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:14.434305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f2988-e158-427c-88b6-3411716ed180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:14.434997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f2988-e158-427c-88b6-3411716ed180 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:14.435279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f2988-e158-427c-88b6-3411716ed180 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:14.435553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f2988-e158-427c-88b6-3411716ed180 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:14.436298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f2988-e158-427c-88b6-3411716ed180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:14.436604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f2988-e158-427c-88b6-3411716ed180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:14.438092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f2988-e158-427c-88b6-3411716ed180 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:14.464412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 412/790] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:14.471554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f2988-e158-427c-88b6-3411716ed180 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:14.476721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e14071-238f-4776-8ae3-edf0d69fd81a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:14.490860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:14.566040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa4ec0-779c-4a14-b171-64919d4dcd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:14.567267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa4ec0-779c-4a14-b171-64919d4dcd44 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:14.567943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa4ec0-779c-4a14-b171-64919d4dcd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:14.568429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa4ec0-779c-4a14-b171-64919d4dcd44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:14.589782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa4ec0-779c-4a14-b171-64919d4dcd44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:14.591821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa4ec0-779c-4a14-b171-64919d4dcd44 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:14.593949 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f2988-e158-427c-88b6-3411716ed180 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:14.630620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f63f99-5e81-4d69-bca0-2b46817e2f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-4aaa4ec0-779c-4a14-b171-64919d4dcd44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:14.631143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:14.632122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:14.633041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:14.633041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:14.633041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:14.633041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:14.633264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f63f99-5e81-4d69-bca0-2b46817e2f83 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:14.633264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f63f99-5e81-4d69-bca0-2b46817e2f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:14.633264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f63f99-5e81-4d69-bca0-2b46817e2f83 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:14.636363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 379/791] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:14.640955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa4ec0-779c-4a14-b171-64919d4dcd44 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:14.641385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f63f99-5e81-4d69-bca0-2b46817e2f83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:14.642972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f63f99-5e81-4d69-bca0-2b46817e2f83 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-62f63f99-5e81-4d69-bca0-2b46817e2f83 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:14.660184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:14.661251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:14.662221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 413/792] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 10:08:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:14.667033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f63f99-5e81-4d69-bca0-2b46817e2f83 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:14.763071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:14.769278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa4ec0-779c-4a14-b171-64919d4dcd44 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:14.807972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2f62d-b5b7-4925-8e98-695d6075ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:14.808955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f62d-b5b7-4925-8e98-695d6075ce04 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:14.809411 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f62d-b5b7-4925-8e98-695d6075ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:14.809831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f62d-b5b7-4925-8e98-695d6075ce04 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:14.810744 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2f62d-b5b7-4925-8e98-695d6075ce04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:14.811194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2f62d-b5b7-4925-8e98-695d6075ce04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:14.812750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2f62d-b5b7-4925-8e98-695d6075ce04 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:14.826592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 380/793] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:14.834936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:14.835869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2f62d-b5b7-4925-8e98-695d6075ce04 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:14.878957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f63f99-5e81-4d69-bca0-2b46817e2f83 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:14.942162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dbbff-70e6-4829-9b9e-280a6a6db915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:14.942879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dbbff-70e6-4829-9b9e-280a6a6db915 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:14.943164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dbbff-70e6-4829-9b9e-280a6a6db915 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:14.943441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dbbff-70e6-4829-9b9e-280a6a6db915 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:14.944299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dbbff-70e6-4829-9b9e-280a6a6db915 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:14.944611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dbbff-70e6-4829-9b9e-280a6a6db915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:14.946089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dbbff-70e6-4829-9b9e-280a6a6db915 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:14.979947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 414/794] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 10:08:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:14.982258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042cab2-894b-4001-a299-3ec90722d109 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:14.982572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042cab2-894b-4001-a299-3ec90722d109 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:14.982849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042cab2-894b-4001-a299-3ec90722d109 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:14.988206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 415/795] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:14.988994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042cab2-894b-4001-a299-3ec90722d109 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:15.004923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2f62d-b5b7-4925-8e98-695d6075ce04 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:15.051518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b755f-3ee8-47f4-9c63-70f73492ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:15.052834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b755f-3ee8-47f4-9c63-70f73492ec9b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.053264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b755f-3ee8-47f4-9c63-70f73492ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.054087 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b755f-3ee8-47f4-9c63-70f73492ec9b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.065161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b755f-3ee8-47f4-9c63-70f73492ec9b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:15.067730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b755f-3ee8-47f4-9c63-70f73492ec9b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8e2b755f-3ee8-47f4-9c63-70f73492ec9b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:15.082864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:15.084085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:15.085314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:15.085314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:15.085314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:15.085314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:15.085314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:15.085314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:15.085314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:15.085314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:15.085314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:08:15.085314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:15.086673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 381/796] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:15.088079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffbcc4-0cf6-45e4-b011-f56034573757 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.088432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffbcc4-0cf6-45e4-b011-f56034573757 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.088771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffbcc4-0cf6-45e4-b011-f56034573757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.107317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042cab2-894b-4001-a299-3ec90722d109 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:15.108585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d3ffbcc4-0cf6-45e4-b011-f56034573757 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:15.110053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d3ffbcc4-0cf6-45e4-b011-f56034573757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:15.139042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:15.140674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:15.150045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293225b-4c18-4fd5-b473-ca96ed848f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:15.151671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293225b-4c18-4fd5-b473-ca96ed848f62 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.152334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293225b-4c18-4fd5-b473-ca96ed848f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.153033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293225b-4c18-4fd5-b473-ca96ed848f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.166547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293225b-4c18-4fd5-b473-ca96ed848f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:15.168452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293225b-4c18-4fd5-b473-ca96ed848f62 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-3293225b-4c18-4fd5-b473-ca96ed848f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:15.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:15.190001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:15.191188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:15.191188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:15.191188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:15.191188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:15.193263 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 416/797] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:15.194376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293225b-4c18-4fd5-b473-ca96ed848f62 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:15.200118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 382/798] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:15.201036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffbcc4-0cf6-45e4-b011-f56034573757 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:15.316115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffbcc4-0cf6-45e4-b011-f56034573757 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:15.329667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293225b-4c18-4fd5-b473-ca96ed848f62 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:15.355061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fa467-bc04-4851-8b4a-f44fffbf2df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:15.356198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa467-bc04-4851-8b4a-f44fffbf2df3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.356696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa467-bc04-4851-8b4a-f44fffbf2df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.357170 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa467-bc04-4851-8b4a-f44fffbf2df3 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.358106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fa467-bc04-4851-8b4a-f44fffbf2df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:15.358723 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fa467-bc04-4851-8b4a-f44fffbf2df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:15.361304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fa467-bc04-4851-8b4a-f44fffbf2df3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:15.372670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05484ca-8950-4de7-9619-523344825e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:15.373635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05484ca-8950-4de7-9619-523344825e5c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.373924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05484ca-8950-4de7-9619-523344825e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.374202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05484ca-8950-4de7-9619-523344825e5c None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.375098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05484ca-8950-4de7-9619-523344825e5c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:15.375414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05484ca-8950-4de7-9619-523344825e5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:15.376937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05484ca-8950-4de7-9619-523344825e5c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:15.377158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 383/799] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:15.378247 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fa467-bc04-4851-8b4a-f44fffbf2df3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:15.393867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:15.400732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 417/800] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 10:08:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:15.401897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05484ca-8950-4de7-9619-523344825e5c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:15.451402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:15.514445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fa467-bc04-4851-8b4a-f44fffbf2df3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:15.524952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05484ca-8950-4de7-9619-523344825e5c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:15.554493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403d635-c08c-4a01-99eb-bc8857ad0f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:15.555316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403d635-c08c-4a01-99eb-bc8857ad0f34 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.555608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403d635-c08c-4a01-99eb-bc8857ad0f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.555901 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403d635-c08c-4a01-99eb-bc8857ad0f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.561549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38042c-7b39-413d-acc0-5239444bc0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:15.562364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38042c-7b39-413d-acc0-5239444bc0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.562712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38042c-7b39-413d-acc0-5239444bc0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.562977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38042c-7b39-413d-acc0-5239444bc0f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.567204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403d635-c08c-4a01-99eb-bc8857ad0f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:15.570205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38042c-7b39-413d-acc0-5239444bc0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:15.571709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38042c-7b39-413d-acc0-5239444bc0f3 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8403d635-c08c-4a01-99eb-bc8857ad0f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:15.574992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:15.575908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:15.576772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 384/801] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:15.577466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403d635-c08c-4a01-99eb-bc8857ad0f34 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-7b38042c-7b39-413d-acc0-5239444bc0f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:15.586291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:15.587300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:15.588227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:15.588227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:15.588227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:15.588227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:15.588227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:15.588227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:15.588227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:15.588227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:15.588227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 418/802] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:15.589603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e2ff1-72f3-4e80-a351-cbdc507d05d8 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.589603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e2ff1-72f3-4e80-a351-cbdc507d05d8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.589603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e2ff1-72f3-4e80-a351-cbdc507d05d8 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.590914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 419/803] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:15.591619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e2ff1-72f3-4e80-a351-cbdc507d05d8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:15.660850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:15.698242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403d635-c08c-4a01-99eb-bc8857ad0f34 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:15.700090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:15.708203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e2ff1-72f3-4e80-a351-cbdc507d05d8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:15.733669 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbbc56-f6b0-49f7-87fd-84d69524f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:15.734596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbbc56-f6b0-49f7-87fd-84d69524f9bc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.734950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbbc56-f6b0-49f7-87fd-84d69524f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.735302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbbc56-f6b0-49f7-87fd-84d69524f9bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.746757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbbc56-f6b0-49f7-87fd-84d69524f9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:15.748288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbbc56-f6b0-49f7-87fd-84d69524f9bc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:15.753233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401769d-8a89-4a05-a9d5-5a7afd3cf41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:15.753942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401769d-8a89-4a05-a9d5-5a7afd3cf41c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.754226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401769d-8a89-4a05-a9d5-5a7afd3cf41c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.754544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401769d-8a89-4a05-a9d5-5a7afd3cf41c None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.755697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401769d-8a89-4a05-a9d5-5a7afd3cf41c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:15.756009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401769d-8a89-4a05-a9d5-5a7afd3cf41c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:15.757809 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401769d-8a89-4a05-a9d5-5a7afd3cf41c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-e0fbbc56-f6b0-49f7-87fd-84d69524f9bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:15.766171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:15.772036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:15.773081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:15.773081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:15.773081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:15.773081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:15.773320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 420/804] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:15.773320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401769d-8a89-4a05-a9d5-5a7afd3cf41c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:15.773457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 385/805] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:15.773457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf9423-636e-4727-ba21-4a95d888e3aa None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.773694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf9423-636e-4727-ba21-4a95d888e3aa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.773895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf9423-636e-4727-ba21-4a95d888e3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.791310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4ecf9423-636e-4727-ba21-4a95d888e3aa None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:15.792493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4ecf9423-636e-4727-ba21-4a95d888e3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:15.870877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 386/806] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:15.872611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf9423-636e-4727-ba21-4a95d888e3aa None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:15.886346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401769d-8a89-4a05-a9d5-5a7afd3cf41c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:15.922295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad3a9e-e2fe-4fd8-8859-f2fa1c03500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:15.923126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3a9e-e2fe-4fd8-8859-f2fa1c03500d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:15.923464 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3a9e-e2fe-4fd8-8859-f2fa1c03500d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:15.923743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3a9e-e2fe-4fd8-8859-f2fa1c03500d None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:15.924537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3a9e-e2fe-4fd8-8859-f2fa1c03500d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:15.924843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3a9e-e2fe-4fd8-8859-f2fa1c03500d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:15.926279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3a9e-e2fe-4fd8-8859-f2fa1c03500d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:15.931856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:15.939302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 421/807] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:15.940138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad3a9e-e2fe-4fd8-8859-f2fa1c03500d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:15.960428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:15.998423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf9423-636e-4727-ba21-4a95d888e3aa None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.047287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ddba9-6603-491d-9f03-1a9d09fbc27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.047968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad3a9e-e2fe-4fd8-8859-f2fa1c03500d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.048313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ddba9-6603-491d-9f03-1a9d09fbc27d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.048313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ddba9-6603-491d-9f03-1a9d09fbc27d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.048713 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ddba9-6603-491d-9f03-1a9d09fbc27d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.059496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ddba9-6603-491d-9f03-1a9d09fbc27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.060967 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ddba9-6603-491d-9f03-1a9d09fbc27d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-990ddba9-6603-491d-9f03-1a9d09fbc27d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:16.080040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:16.080983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:16.081922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:16.081922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:16.081922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:16.081922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:16.081922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 387/808] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:16.082201 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ddba9-6603-491d-9f03-1a9d09fbc27d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.090528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed76f4a-f041-40e6-af80-3474ea1c5646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.091224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed76f4a-f041-40e6-af80-3474ea1c5646 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.091619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed76f4a-f041-40e6-af80-3474ea1c5646 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.091897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed76f4a-f041-40e6-af80-3474ea1c5646 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.092624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed76f4a-f041-40e6-af80-3474ea1c5646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:16.092934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed76f4a-f041-40e6-af80-3474ea1c5646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.094329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed76f4a-f041-40e6-af80-3474ea1c5646 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.110838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 422/809] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:16.110838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed76f4a-f041-40e6-af80-3474ea1c5646 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.193374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:16.194149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ddba9-6603-491d-9f03-1a9d09fbc27d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.196112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:16.218812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed76f4a-f041-40e6-af80-3474ea1c5646 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.234314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9817-b936-4bc3-805a-6fa8ada5c1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.235259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9817-b936-4bc3-805a-6fa8ada5c1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.235550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9817-b936-4bc3-805a-6fa8ada5c1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.235825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9817-b936-4bc3-805a-6fa8ada5c1c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.236487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed9817-b936-4bc3-805a-6fa8ada5c1c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.237864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed9817-b936-4bc3-805a-6fa8ada5c1c5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a0ed9817-b936-4bc3-805a-6fa8ada5c1c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:16.250305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:16.251311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:16.252166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 388/810] 10.222.0.66 () {56 vars in 1129 bytes} [Wed Jun 22 10:08:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:16.253661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9817-b936-4bc3-805a-6fa8ada5c1c5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.260166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409795d-0046-47db-82e1-80b08b407a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.261077 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409795d-0046-47db-82e1-80b08b407a58 None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.261360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409795d-0046-47db-82e1-80b08b407a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.261635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409795d-0046-47db-82e1-80b08b407a58 None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/7701ac0e772842e29e9e6903ff551a13/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.277046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409795d-0046-47db-82e1-80b08b407a58 None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=7701ac0e772842e29e9e6903ff551a13, role_id=111ab6c88aad4c2b96cc3d7ada1e2dc3)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.278583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409795d-0046-47db-82e1-80b08b407a58 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.300693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 423/811] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:08:16 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/7701ac0e772842e29e9e6903ff551a13/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:08:16.300693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409795d-0046-47db-82e1-80b08b407a58 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.384173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9817-b936-4bc3-805a-6fa8ada5c1c5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.416717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409795d-0046-47db-82e1-80b08b407a58 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.425516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03906c59-a1e2-4a77-a430-91f24ff91101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.426201 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03906c59-a1e2-4a77-a430-91f24ff91101 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.426489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03906c59-a1e2-4a77-a430-91f24ff91101 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.426797 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03906c59-a1e2-4a77-a430-91f24ff91101 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.427535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03906c59-a1e2-4a77-a430-91f24ff91101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:16.427854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03906c59-a1e2-4a77-a430-91f24ff91101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.429387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03906c59-a1e2-4a77-a430-91f24ff91101 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.447643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 389/812] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:16.447643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03906c59-a1e2-4a77-a430-91f24ff91101 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.454279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:16.465831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7468fee-f8f4-441b-9c4f-6d2acfb32111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.466685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7468fee-f8f4-441b-9c4f-6d2acfb32111 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.466975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7468fee-f8f4-441b-9c4f-6d2acfb32111 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.467251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7468fee-f8f4-441b-9c4f-6d2acfb32111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.474889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7468fee-f8f4-441b-9c4f-6d2acfb32111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.477142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7468fee-f8f4-441b-9c4f-6d2acfb32111 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.479849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-d7468fee-f8f4-441b-9c4f-6d2acfb32111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:16.499664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:16.500670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:16.501589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:16.501589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:16.501589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:16.501589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:16.501589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:16.501589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:16.501589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:16.501589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:16.501589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 424/813] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:16.503619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c612ed2-f05a-403b-a562-8258cd033ef1 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.504072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c612ed2-f05a-403b-a562-8258cd033ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.504355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c612ed2-f05a-403b-a562-8258cd033ef1 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.505757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 425/814] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:16.506468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c612ed2-f05a-403b-a562-8258cd033ef1 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.564398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03906c59-a1e2-4a77-a430-91f24ff91101 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.601382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411cfe4-8191-4951-9396-0c06af5d3ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.602053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411cfe4-8191-4951-9396-0c06af5d3ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.602334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411cfe4-8191-4951-9396-0c06af5d3ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.602630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411cfe4-8191-4951-9396-0c06af5d3ad5 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.603377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411cfe4-8191-4951-9396-0c06af5d3ad5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:16.603681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411cfe4-8191-4951-9396-0c06af5d3ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.605057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411cfe4-8191-4951-9396-0c06af5d3ad5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.614271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 390/815] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 10:08:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:16.614271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411cfe4-8191-4951-9396-0c06af5d3ad5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.622597 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c612ed2-f05a-403b-a562-8258cd033ef1 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.660268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b71a8-1e1d-4b3a-ad4a-3d8dac446179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.661345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b71a8-1e1d-4b3a-ad4a-3d8dac446179 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.661625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b71a8-1e1d-4b3a-ad4a-3d8dac446179 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.661897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b71a8-1e1d-4b3a-ad4a-3d8dac446179 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.670044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b71a8-1e1d-4b3a-ad4a-3d8dac446179 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.671546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b71a8-1e1d-4b3a-ad4a-3d8dac446179 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-9b3b71a8-1e1d-4b3a-ad4a-3d8dac446179 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:16.686026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:16.687123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:16.688697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 426/816] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 10:08:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:16.689320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f292-e0e9-4ec6-92c7-fd2125029c58 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.689320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f292-e0e9-4ec6-92c7-fd2125029c58 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.689320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f292-e0e9-4ec6-92c7-fd2125029c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.706648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b1e9f292-e0e9-4ec6-92c7-fd2125029c58 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:16.707770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b1e9f292-e0e9-4ec6-92c7-fd2125029c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:16.721958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:16.734642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411cfe4-8191-4951-9396-0c06af5d3ad5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.753985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:16.775410 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa2018-590c-414d-b8dc-8af79661560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.776080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa2018-590c-414d-b8dc-8af79661560f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.776359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa2018-590c-414d-b8dc-8af79661560f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.776630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa2018-590c-414d-b8dc-8af79661560f None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.777417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa2018-590c-414d-b8dc-8af79661560f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:16.777766 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa2018-590c-414d-b8dc-8af79661560f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.788550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 427/817] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:16.788746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa2018-590c-414d-b8dc-8af79661560f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.788828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f292-e0e9-4ec6-92c7-fd2125029c58 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.796892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 391/818] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:16.797881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa2018-590c-414d-b8dc-8af79661560f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.893335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f292-e0e9-4ec6-92c7-fd2125029c58 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.913960 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa2018-590c-414d-b8dc-8af79661560f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.930467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c232d8d-7a68-4d5e-a5ce-328bbf568f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.931156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c232d8d-7a68-4d5e-a5ce-328bbf568f17 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.931437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c232d8d-7a68-4d5e-a5ce-328bbf568f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.931707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c232d8d-7a68-4d5e-a5ce-328bbf568f17 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.932416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c232d8d-7a68-4d5e-a5ce-328bbf568f17 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:16.932718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c232d8d-7a68-4d5e-a5ce-328bbf568f17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.934119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c232d8d-7a68-4d5e-a5ce-328bbf568f17 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.943822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 428/819] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 10:08:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:16.943822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c232d8d-7a68-4d5e-a5ce-328bbf568f17 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.954326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10d784-e70a-466e-8eda-3204e0708dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.955044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d784-e70a-466e-8eda-3204e0708dbd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.955330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d784-e70a-466e-8eda-3204e0708dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.955607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d784-e70a-466e-8eda-3204e0708dbd None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.956453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10d784-e70a-466e-8eda-3204e0708dbd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:16.956819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10d784-e70a-466e-8eda-3204e0708dbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.958209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10d784-e70a-466e-8eda-3204e0708dbd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.977277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 392/820] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 10:08:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:16.978443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10d784-e70a-466e-8eda-3204e0708dbd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.989437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:16.993772 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:17.058384 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c232d8d-7a68-4d5e-a5ce-328bbf568f17 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:17.098659 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade4088-87ab-4568-9a96-63a83a0d72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:17.099578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade4088-87ab-4568-9a96-63a83a0d72ac None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:17.099858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade4088-87ab-4568-9a96-63a83a0d72ac None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:17.100139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade4088-87ab-4568-9a96-63a83a0d72ac None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/b0c07436108d4a2089a74e7891b849c5/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:17.102211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade4088-87ab-4568-9a96-63a83a0d72ac None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=b0c07436108d4a2089a74e7891b849c5, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:17.103741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade4088-87ab-4568-9a96-63a83a0d72ac None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:17.126537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 429/821] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:08:16 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/b0c07436108d4a2089a74e7891b849c5/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:08:17.126537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade4088-87ab-4568-9a96-63a83a0d72ac None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:17.232146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10d784-e70a-466e-8eda-3204e0708dbd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:17.269026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade4088-87ab-4568-9a96-63a83a0d72ac None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:17.271116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:17.283806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63900d5-bb55-4c47-9717-2f64376459bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:17.285368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63900d5-bb55-4c47-9717-2f64376459bc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:17.285827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63900d5-bb55-4c47-9717-2f64376459bc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:17.286976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63900d5-bb55-4c47-9717-2f64376459bc None admin] PATH_INFO: `/v3/services/network` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:17.287727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63900d5-bb55-4c47-9717-2f64376459bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:17.289289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63900d5-bb55-4c47-9717-2f64376459bc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b63900d5-bb55-4c47-9717-2f64376459bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:17.304196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:17.305261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:08:17.306148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:17.307568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 393/822] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:16 2022] GET /identity/v3/services/network => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:17.308735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63900d5-bb55-4c47-9717-2f64376459bc None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:17.323392 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5af81-139e-4925-92ff-a901a623f41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:17.324421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5af81-139e-4925-92ff-a901a623f41f None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:17.324663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5af81-139e-4925-92ff-a901a623f41f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:17.324933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5af81-139e-4925-92ff-a901a623f41f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:17.325684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5af81-139e-4925-92ff-a901a623f41f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:17.327196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5af81-139e-4925-92ff-a901a623f41f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:17.370527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 430/823] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 10:08:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:17.370527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5af81-139e-4925-92ff-a901a623f41f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:17.461507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:17.526076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5af81-139e-4925-92ff-a901a623f41f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:17.563154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51bde8-cec0-4073-81e5-2adceb844f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:17.563833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bde8-cec0-4073-81e5-2adceb844f4e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:17.564120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bde8-cec0-4073-81e5-2adceb844f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:17.564399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bde8-cec0-4073-81e5-2adceb844f4e None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:17.564866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63900d5-bb55-4c47-9717-2f64376459bc None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:17.565121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51bde8-cec0-4073-81e5-2adceb844f4e None admin] RBAC: Adding query filter params (name=network) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:17.565430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51bde8-cec0-4073-81e5-2adceb844f4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:17.566872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51bde8-cec0-4073-81e5-2adceb844f4e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:17.576614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 431/824] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:17.578284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51bde8-cec0-4073-81e5-2adceb844f4e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:17.607147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:17.616643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801da7f-3889-451b-b1b5-204345c0b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:17.617329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801da7f-3889-451b-b1b5-204345c0b532 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:17.617637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801da7f-3889-451b-b1b5-204345c0b532 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:17.618031 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801da7f-3889-451b-b1b5-204345c0b532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:17.714930 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801da7f-3889-451b-b1b5-204345c0b532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:17.716559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801da7f-3889-451b-b1b5-204345c0b532 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:17.806785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:17.838371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 394/825] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:17.844615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801da7f-3889-451b-b1b5-204345c0b532 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:17.880323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51bde8-cec0-4073-81e5-2adceb844f4e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:17.939157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871c69f-d710-4b8a-94d1-519c39963303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:17.939862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871c69f-d710-4b8a-94d1-519c39963303 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:17.940141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871c69f-d710-4b8a-94d1-519c39963303 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:17.940414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871c69f-d710-4b8a-94d1-519c39963303 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:17.941122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871c69f-d710-4b8a-94d1-519c39963303 None admin] RBAC: Adding query filter params (type=network) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:17.941423 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871c69f-d710-4b8a-94d1-519c39963303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:17.942829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871c69f-d710-4b8a-94d1-519c39963303 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:17.948823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 432/826] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:17.955044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871c69f-d710-4b8a-94d1-519c39963303 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:18.042228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801da7f-3889-451b-b1b5-204345c0b532 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:18.042478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:18.066621 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871c69f-d710-4b8a-94d1-519c39963303 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:18.098722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd7b54-8b5c-4188-a2c5-23c93a27071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:18.099412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd7b54-8b5c-4188-a2c5-23c93a27071c None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:18.099691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd7b54-8b5c-4188-a2c5-23c93a27071c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:18.099958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd7b54-8b5c-4188-a2c5-23c93a27071c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:18.100694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd7b54-8b5c-4188-a2c5-23c93a27071c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:18.102071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd7b54-8b5c-4188-a2c5-23c93a27071c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:18.119835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f3e32-2b07-42ad-8551-215389f0dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:18.121058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f3e32-2b07-42ad-8551-215389f0dffa None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:18.121632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f3e32-2b07-42ad-8551-215389f0dffa None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:18.122130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f3e32-2b07-42ad-8551-215389f0dffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:18.129584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 433/827] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 10:08:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:08:18.151202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f3e32-2b07-42ad-8551-215389f0dffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:18.153165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f3e32-2b07-42ad-8551-215389f0dffa None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7a3f3e32-2b07-42ad-8551-215389f0dffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:18.184486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:18.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:18.186406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:18.186406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:18.186406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:18.186406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:18.186406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 395/828] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:18.193014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd7b54-8b5c-4188-a2c5-23c93a27071c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:18.370350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd7b54-8b5c-4188-a2c5-23c93a27071c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:18.413073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387d522-3229-4323-88ff-2bf9ab20a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:18.413748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d522-3229-4323-88ff-2bf9ab20a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:18.414029 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d522-3229-4323-88ff-2bf9ab20a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:18.414302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d522-3229-4323-88ff-2bf9ab20a4a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:18.415056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387d522-3229-4323-88ff-2bf9ab20a4a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:18.415361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387d522-3229-4323-88ff-2bf9ab20a4a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:18.416739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387d522-3229-4323-88ff-2bf9ab20a4a0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:18.418315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:18.431421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 434/829] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:18.438569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f3e32-2b07-42ad-8551-215389f0dffa None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:18.474691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:18.553629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f3e32-2b07-42ad-8551-215389f0dffa None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:18.585615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcab27-22fc-428a-af2c-34ce5eb91ce8 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:18.585955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcab27-22fc-428a-af2c-34ce5eb91ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:18.586168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcab27-22fc-428a-af2c-34ce5eb91ce8 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:18.587920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 435/830] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:18.595623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6075e-89f0-40f4-8b4a-692ea6566854 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:18.596066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6075e-89f0-40f4-8b4a-692ea6566854 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:18.596459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6075e-89f0-40f4-8b4a-692ea6566854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:18.602299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be9901-5ccc-4bda-8bf4-1ce5200005d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:18.603357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be9901-5ccc-4bda-8bf4-1ce5200005d3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:18.603471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be9901-5ccc-4bda-8bf4-1ce5200005d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:18.603693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be9901-5ccc-4bda-8bf4-1ce5200005d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:18.611202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be9901-5ccc-4bda-8bf4-1ce5200005d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:18.612664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be9901-5ccc-4bda-8bf4-1ce5200005d3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:18.621143 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c6d6075e-89f0-40f4-8b4a-692ea6566854 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:18.622376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c6d6075e-89f0-40f4-8b4a-692ea6566854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a5be9901-5ccc-4bda-8bf4-1ce5200005d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:18.628073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:18.629052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:18.630097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:18.630097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:18.630097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:18.630097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:18.630097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:18.630097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:18.630097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:18.630097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:18.630097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 396/831] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:18.637681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be9901-5ccc-4bda-8bf4-1ce5200005d3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:18.701596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 436/832] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:18.724737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6075e-89f0-40f4-8b4a-692ea6566854 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:18.749465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:18.774652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be9901-5ccc-4bda-8bf4-1ce5200005d3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:18.823238 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21bd40-a340-4bd5-a208-6dfa31c5fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:18.824161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21bd40-a340-4bd5-a208-6dfa31c5fbab None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:18.824485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21bd40-a340-4bd5-a208-6dfa31c5fbab None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:18.825180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21bd40-a340-4bd5-a208-6dfa31c5fbab None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:18.826268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21bd40-a340-4bd5-a208-6dfa31c5fbab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:18.826608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21bd40-a340-4bd5-a208-6dfa31c5fbab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:18.828872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21bd40-a340-4bd5-a208-6dfa31c5fbab None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:18.836770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6075e-89f0-40f4-8b4a-692ea6566854 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:18.844401 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 397/833] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:18.854437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21bd40-a340-4bd5-a208-6dfa31c5fbab None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:18.870980 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:18.883983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b07b0-064b-471d-bd0e-30aa938fcaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:18.884777 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b07b0-064b-471d-bd0e-30aa938fcaba None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:18.885063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b07b0-064b-471d-bd0e-30aa938fcaba None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:18.885339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b07b0-064b-471d-bd0e-30aa938fcaba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:18.899090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b07b0-064b-471d-bd0e-30aa938fcaba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-179b07b0-064b-471d-bd0e-30aa938fcaba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:18.909119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:18.910113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:18.911368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 437/834] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:08:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:18.916248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b07b0-064b-471d-bd0e-30aa938fcaba None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:18.983762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21bd40-a340-4bd5-a208-6dfa31c5fbab None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:19.018924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da789f-9638-4833-804d-526d60ff5e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:19.019974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da789f-9638-4833-804d-526d60ff5e4f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.020448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da789f-9638-4833-804d-526d60ff5e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.020914 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da789f-9638-4833-804d-526d60ff5e4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.021940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da789f-9638-4833-804d-526d60ff5e4f None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=f91c2e9ae8844d9181aff785c02cf3be) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:19.022452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da789f-9638-4833-804d-526d60ff5e4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:19.024101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da789f-9638-4833-804d-526d60ff5e4f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:19.025646 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b07b0-064b-471d-bd0e-30aa938fcaba None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:19.038806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 398/835] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:18 2022] GET /identity/v3/role_assignments?user.id=f91c2e9ae8844d9181aff785c02cf3be&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:19.065996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe17ff-cbf6-4829-af4b-89501e02d70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:19.066988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe17ff-cbf6-4829-af4b-89501e02d70f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.067517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe17ff-cbf6-4829-af4b-89501e02d70f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.067517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe17ff-cbf6-4829-af4b-89501e02d70f None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.068290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe17ff-cbf6-4829-af4b-89501e02d70f None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:19.068598 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe17ff-cbf6-4829-af4b-89501e02d70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:19.070136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe17ff-cbf6-4829-af4b-89501e02d70f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:19.080481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 438/836] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:08:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:19.086296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da789f-9638-4833-804d-526d60ff5e4f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:19.101052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:19.205082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da789f-9638-4833-804d-526d60ff5e4f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:19.242917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8a90e-133b-4033-a6b0-be14da82e23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:19.244090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8a90e-133b-4033-a6b0-be14da82e23d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.244591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8a90e-133b-4033-a6b0-be14da82e23d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.244954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8a90e-133b-4033-a6b0-be14da82e23d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.256496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8a90e-133b-4033-a6b0-be14da82e23d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:19.258084 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8a90e-133b-4033-a6b0-be14da82e23d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a4c8a90e-133b-4033-a6b0-be14da82e23d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:19.277180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:19.278354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:19.279528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:19.279528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:19.279528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:19.279528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:19.281489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 399/837] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:19.287514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe17ff-cbf6-4829-af4b-89501e02d70f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:19.338899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:19.395597 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe17ff-cbf6-4829-af4b-89501e02d70f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:19.430321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc66793-25f7-430a-8319-9866e917f20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:19.431072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc66793-25f7-430a-8319-9866e917f20a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.431415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc66793-25f7-430a-8319-9866e917f20a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.431690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc66793-25f7-430a-8319-9866e917f20a None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.432414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc66793-25f7-430a-8319-9866e917f20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:19.432715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc66793-25f7-430a-8319-9866e917f20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:19.432816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e7d9-6141-4276-bd7d-3f891df39602 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.433003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e7d9-6141-4276-bd7d-3f891df39602 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.433288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e7d9-6141-4276-bd7d-3f891df39602 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.434184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc66793-25f7-430a-8319-9866e917f20a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:19.435215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 400/838] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:19.440406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaeb68a-aab6-45f0-a7c5-c032d9280053 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.440974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaeb68a-aab6-45f0-a7c5-c032d9280053 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.440974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaeb68a-aab6-45f0-a7c5-c032d9280053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.447555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 439/839] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:19.452825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc66793-25f7-430a-8319-9866e917f20a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:19.461962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ccaeb68a-aab6-45f0-a7c5-c032d9280053 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:19.463617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ccaeb68a-aab6-45f0-a7c5-c032d9280053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:19.541996 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:19.566601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 401/840] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:19.586950 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc66793-25f7-430a-8319-9866e917f20a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:19.588914 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaeb68a-aab6-45f0-a7c5-c032d9280053 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:19.598039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:19.628173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50cdd7-1d53-47b0-88ac-cd59a7568707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:19.629388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50cdd7-1d53-47b0-88ac-cd59a7568707 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.629877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50cdd7-1d53-47b0-88ac-cd59a7568707 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.630363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50cdd7-1d53-47b0-88ac-cd59a7568707 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.638583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50cdd7-1d53-47b0-88ac-cd59a7568707 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:19.640340 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50cdd7-1d53-47b0-88ac-cd59a7568707 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-fb50cdd7-1d53-47b0-88ac-cd59a7568707 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:19.656685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:19.657728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:19.659099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 440/841] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 10:08:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:19.664065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50cdd7-1d53-47b0-88ac-cd59a7568707 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:19.714304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaeb68a-aab6-45f0-a7c5-c032d9280053 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:19.751076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c5ee2-180c-41e5-9fee-f7bc4b6259c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:19.752188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c5ee2-180c-41e5-9fee-f7bc4b6259c0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.752642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c5ee2-180c-41e5-9fee-f7bc4b6259c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.753146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c5ee2-180c-41e5-9fee-f7bc4b6259c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.764792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c5ee2-180c-41e5-9fee-f7bc4b6259c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3f7c5ee2-180c-41e5-9fee-f7bc4b6259c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:19.772502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:19.773445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:19.774322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 402/842] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:19.775573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225246-3525-433f-91cb-663a87e4220b None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.775573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225246-3525-433f-91cb-663a87e4220b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.775573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225246-3525-433f-91cb-663a87e4220b None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.776868 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 403/843] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:19.780645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50cdd7-1d53-47b0-88ac-cd59a7568707 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:19.781499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7225246-3525-433f-91cb-663a87e4220b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:19.817485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5e4b9-b46f-4719-a876-ec2f40bba273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:19.818153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5e4b9-b46f-4719-a876-ec2f40bba273 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.818437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5e4b9-b46f-4719-a876-ec2f40bba273 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.818745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5e4b9-b46f-4719-a876-ec2f40bba273 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.819592 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5e4b9-b46f-4719-a876-ec2f40bba273 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:19.819940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5e4b9-b46f-4719-a876-ec2f40bba273 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:19.821345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5e4b9-b46f-4719-a876-ec2f40bba273 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:19.838719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:19.846040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 441/844] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 10:08:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:19.847625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639a3fd-1e3f-4df6-9025-cf581ef853d3 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.847913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639a3fd-1e3f-4df6-9025-cf581ef853d3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.848232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639a3fd-1e3f-4df6-9025-cf581ef853d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.866317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a639a3fd-1e3f-4df6-9025-cf581ef853d3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:19.867881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a639a3fd-1e3f-4df6-9025-cf581ef853d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:19.887833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:19.892002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7225246-3525-433f-91cb-663a87e4220b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:19.930798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01ed54-b8bb-4718-9cf6-1186975b833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:19.931457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ed54-b8bb-4718-9cf6-1186975b833c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:19.931739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ed54-b8bb-4718-9cf6-1186975b833c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:19.932011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ed54-b8bb-4718-9cf6-1186975b833c None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:19.932755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01ed54-b8bb-4718-9cf6-1186975b833c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:19.933060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01ed54-b8bb-4718-9cf6-1186975b833c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:19.934471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01ed54-b8bb-4718-9cf6-1186975b833c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:19.943108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 442/845] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:19.946528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 404/846] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:08:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:19.948822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639a3fd-1e3f-4df6-9025-cf581ef853d3 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:19.949314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01ed54-b8bb-4718-9cf6-1186975b833c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.048870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01ed54-b8bb-4718-9cf6-1186975b833c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.062898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:20.073373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639a3fd-1e3f-4df6-9025-cf581ef853d3 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.085105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41492294-c3dd-4c5e-a793-47cc92359b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:20.086202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492294-c3dd-4c5e-a793-47cc92359b31 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.086477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492294-c3dd-4c5e-a793-47cc92359b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.086780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492294-c3dd-4c5e-a793-47cc92359b31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.098189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41492294-c3dd-4c5e-a793-47cc92359b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:20.099670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41492294-c3dd-4c5e-a793-47cc92359b31 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:20.112017 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52182d2-c7c8-42dc-835d-2f5e83c7655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:20.112670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52182d2-c7c8-42dc-835d-2f5e83c7655f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.112951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52182d2-c7c8-42dc-835d-2f5e83c7655f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.113251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52182d2-c7c8-42dc-835d-2f5e83c7655f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-41492294-c3dd-4c5e-a793-47cc92359b31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:20.117429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:20.118338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:20.119857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:20.119857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:20.119857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:20.119857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:20.119857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 405/847] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:20.119857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41492294-c3dd-4c5e-a793-47cc92359b31 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.142848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:20.191821 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52182d2-c7c8-42dc-835d-2f5e83c7655f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:20.193516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52182d2-c7c8-42dc-835d-2f5e83c7655f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:20.232160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41492294-c3dd-4c5e-a793-47cc92359b31 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.275101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557633d-b02f-443e-8cc3-117fe90b7f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:20.275905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557633d-b02f-443e-8cc3-117fe90b7f11 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.276189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557633d-b02f-443e-8cc3-117fe90b7f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.276483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557633d-b02f-443e-8cc3-117fe90b7f11 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.277134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557633d-b02f-443e-8cc3-117fe90b7f11 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:20.278615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557633d-b02f-443e-8cc3-117fe90b7f11 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7557633d-b02f-443e-8cc3-117fe90b7f11 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:20.291559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:20.292759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:20.293601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 406/848] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:08:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:20.294411 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557633d-b02f-443e-8cc3-117fe90b7f11 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.318921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 443/849] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:20.320174 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52182d2-c7c8-42dc-835d-2f5e83c7655f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.329301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:20.387601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:20.416811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557633d-b02f-443e-8cc3-117fe90b7f11 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.434230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52182d2-c7c8-42dc-835d-2f5e83c7655f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.455386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c781-1ca3-40a5-a777-b0b957def69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:20.456161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c781-1ca3-40a5-a777-b0b957def69c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.456515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c781-1ca3-40a5-a777-b0b957def69c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.456799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c781-1ca3-40a5-a777-b0b957def69c None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.457530 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92c781-1ca3-40a5-a777-b0b957def69c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:20.457839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92c781-1ca3-40a5-a777-b0b957def69c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:20.459293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92c781-1ca3-40a5-a777-b0b957def69c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:20.471342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a01ec-e04e-4650-a768-26fb05f6f9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:20.476509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 407/850] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:20.476661 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a01ec-e04e-4650-a768-26fb05f6f9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.476661 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a01ec-e04e-4650-a768-26fb05f6f9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.476817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c781-1ca3-40a5-a777-b0b957def69c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.476892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a01ec-e04e-4650-a768-26fb05f6f9d2 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.476892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a01ec-e04e-4650-a768-26fb05f6f9d2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:20.476892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a01ec-e04e-4650-a768-26fb05f6f9d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:20.476892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a01ec-e04e-4650-a768-26fb05f6f9d2 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:20.482593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 444/851] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:08:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:20.483264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a01ec-e04e-4650-a768-26fb05f6f9d2 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.573952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:20.587827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c781-1ca3-40a5-a777-b0b957def69c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.589466 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a01ec-e04e-4650-a768-26fb05f6f9d2 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.608345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:20.628083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47cf9-eb01-40c9-806c-f315701e55cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:20.628767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52c1ba-2449-4e46-bc76-429b20d1ed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:20.628963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47cf9-eb01-40c9-806c-f315701e55cf None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.629247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47cf9-eb01-40c9-806c-f315701e55cf None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.629523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47cf9-eb01-40c9-806c-f315701e55cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.629644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52c1ba-2449-4e46-bc76-429b20d1ed53 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.629831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52c1ba-2449-4e46-bc76-429b20d1ed53 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.630103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52c1ba-2449-4e46-bc76-429b20d1ed53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.639717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f47cf9-eb01-40c9-806c-f315701e55cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:20.639717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f47cf9-eb01-40c9-806c-f315701e55cf None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:20.644496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52c1ba-2449-4e46-bc76-429b20d1ed53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:20.645958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52c1ba-2449-4e46-bc76-429b20d1ed53 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-49f47cf9-eb01-40c9-806c-f315701e55cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:20.656069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:20.657069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:20.658342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 445/852] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:20.659382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47cf9-eb01-40c9-806c-f315701e55cf None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-6e52c1ba-2449-4e46-bc76-429b20d1ed53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:20.670327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:20.671377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:20.672296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:20.672296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:20.672296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:20.672296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:20.672296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 408/853] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:20.673286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52c1ba-2449-4e46-bc76-429b20d1ed53 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.767560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47cf9-eb01-40c9-806c-f315701e55cf None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.778323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52c1ba-2449-4e46-bc76-429b20d1ed53 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.806651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308cee-cf6f-4b34-bd7f-31a7a34e94ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:20.807337 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308cee-cf6f-4b34-bd7f-31a7a34e94ed None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.807625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308cee-cf6f-4b34-bd7f-31a7a34e94ed None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.807905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308cee-cf6f-4b34-bd7f-31a7a34e94ed None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.808656 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308cee-cf6f-4b34-bd7f-31a7a34e94ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:20.809315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308cee-cf6f-4b34-bd7f-31a7a34e94ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:20.810361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308cee-cf6f-4b34-bd7f-31a7a34e94ed None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:20.815783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 446/854] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:08:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:20.818664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68274cc-0956-42bf-85ab-2ee4fbe39b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:20.819353 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68274cc-0956-42bf-85ab-2ee4fbe39b0e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.819630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68274cc-0956-42bf-85ab-2ee4fbe39b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.819906 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68274cc-0956-42bf-85ab-2ee4fbe39b0e None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.820763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68274cc-0956-42bf-85ab-2ee4fbe39b0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:20.821070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68274cc-0956-42bf-85ab-2ee4fbe39b0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:20.822584 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68274cc-0956-42bf-85ab-2ee4fbe39b0e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:20.826974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308cee-cf6f-4b34-bd7f-31a7a34e94ed None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.834363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:20.847179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 409/855] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 10:08:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:20.852716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68274cc-0956-42bf-85ab-2ee4fbe39b0e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.895470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:20.973818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308cee-cf6f-4b34-bd7f-31a7a34e94ed None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.998151 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68274cc-0956-42bf-85ab-2ee4fbe39b0e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:21.027429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e7c1c-d470-4a10-94fd-eaf9f9bc0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:21.028149 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7c1c-d470-4a10-94fd-eaf9f9bc0898 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.028434 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7c1c-d470-4a10-94fd-eaf9f9bc0898 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.028709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7c1c-d470-4a10-94fd-eaf9f9bc0898 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.029456 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e7c1c-d470-4a10-94fd-eaf9f9bc0898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:21.029762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e7c1c-d470-4a10-94fd-eaf9f9bc0898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:21.031283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e7c1c-d470-4a10-94fd-eaf9f9bc0898 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:21.045401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 447/856] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:21.045978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61933f4-833d-4749-b2f9-a7458d19f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:21.046846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61933f4-833d-4749-b2f9-a7458d19f372 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.047286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61933f4-833d-4749-b2f9-a7458d19f372 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.047686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61933f4-833d-4749-b2f9-a7458d19f372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.050454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e7c1c-d470-4a10-94fd-eaf9f9bc0898 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:21.161067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:21.165603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61933f4-833d-4749-b2f9-a7458d19f372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:21.168197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61933f4-833d-4749-b2f9-a7458d19f372 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:21.168559 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e7c1c-d470-4a10-94fd-eaf9f9bc0898 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:21.170228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:21.207725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949280c8-2e8e-46f5-b5e0-5e257daa0912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:21.208562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949280c8-2e8e-46f5-b5e0-5e257daa0912 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.208846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949280c8-2e8e-46f5-b5e0-5e257daa0912 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.209158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949280c8-2e8e-46f5-b5e0-5e257daa0912 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.216784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949280c8-2e8e-46f5-b5e0-5e257daa0912 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:21.218178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949280c8-2e8e-46f5-b5e0-5e257daa0912 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-949280c8-2e8e-46f5-b5e0-5e257daa0912 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:21.233006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:21.233972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:21.235124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:21.235124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:21.235124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:21.235124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:21.235124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:21.235124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:21.235124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:21.235124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:21.239100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 448/857] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:21.240535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2111ea-24b5-4311-994a-bfc31e83efc2 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.240821 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2111ea-24b5-4311-994a-bfc31e83efc2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.241118 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2111ea-24b5-4311-994a-bfc31e83efc2 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.242461 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 449/858] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:21.243197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2111ea-24b5-4311-994a-bfc31e83efc2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:21.282945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 410/859] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:21.285040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21581b93-266d-4956-a50f-6a8f391440b0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.285523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21581b93-266d-4956-a50f-6a8f391440b0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.285999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21581b93-266d-4956-a50f-6a8f391440b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.303189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-21581b93-266d-4956-a50f-6a8f391440b0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:21.304613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-21581b93-266d-4956-a50f-6a8f391440b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:21.365168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2111ea-24b5-4311-994a-bfc31e83efc2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:21.373604 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 411/860] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:21.375290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21581b93-266d-4956-a50f-6a8f391440b0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:21.412824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:21.419030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbef81-7986-4048-bf67-b6e005404c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:21.419937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbef81-7986-4048-bf67-b6e005404c94 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.420218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbef81-7986-4048-bf67-b6e005404c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.420487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbef81-7986-4048-bf67-b6e005404c94 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.421284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbef81-7986-4048-bf67-b6e005404c94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:21.421588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbef81-7986-4048-bf67-b6e005404c94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:21.423083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbef81-7986-4048-bf67-b6e005404c94 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:21.438541 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 450/861] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:21.438541 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbef81-7986-4048-bf67-b6e005404c94 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:21.462619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:21.497032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21581b93-266d-4956-a50f-6a8f391440b0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:21.533738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf630-12e7-4a2c-a449-74ca241e7ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:21.534565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf630-12e7-4a2c-a449-74ca241e7ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.534843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf630-12e7-4a2c-a449-74ca241e7ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.535109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf630-12e7-4a2c-a449-74ca241e7ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.546175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf630-12e7-4a2c-a449-74ca241e7ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:21.547230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbef81-7986-4048-bf67-b6e005404c94 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:21.547679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf630-12e7-4a2c-a449-74ca241e7ae1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5abbf630-12e7-4a2c-a449-74ca241e7ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:21.569329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:21.570447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:21.571413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:21.571413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:21.571413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:21.571413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:21.571413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 412/862] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:21.571413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf630-12e7-4a2c-a449-74ca241e7ae1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:21.593746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8711-f691-4f2e-8d7e-04e3fb450e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:21.594611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8711-f691-4f2e-8d7e-04e3fb450e39 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.594901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8711-f691-4f2e-8d7e-04e3fb450e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.595178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8711-f691-4f2e-8d7e-04e3fb450e39 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.595841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f8711-f691-4f2e-8d7e-04e3fb450e39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:21.597236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f8711-f691-4f2e-8d7e-04e3fb450e39 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-506f8711-f691-4f2e-8d7e-04e3fb450e39 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:21.610954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:21.612000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:21.612865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 451/863] 10.222.0.66 () {56 vars in 1132 bytes} [Wed Jun 22 10:08:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:21.613754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8711-f691-4f2e-8d7e-04e3fb450e39 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:21.663137 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:21.684159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf630-12e7-4a2c-a449-74ca241e7ae1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:21.707891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:21.720822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d662fa-7c1e-4327-9c2a-80b5a71cd6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:21.721476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d662fa-7c1e-4327-9c2a-80b5a71cd6ce None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.721752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d662fa-7c1e-4327-9c2a-80b5a71cd6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.722036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d662fa-7c1e-4327-9c2a-80b5a71cd6ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.722885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d662fa-7c1e-4327-9c2a-80b5a71cd6ce None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=7701ac0e772842e29e9e6903ff551a13) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:21.723191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d662fa-7c1e-4327-9c2a-80b5a71cd6ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:21.724619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d662fa-7c1e-4327-9c2a-80b5a71cd6ce None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:21.725094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8711-f691-4f2e-8d7e-04e3fb450e39 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:21.738536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 413/864] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:21 2022] GET /identity/v3/role_assignments?user.id=7701ac0e772842e29e9e6903ff551a13&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:21.738536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d662fa-7c1e-4327-9c2a-80b5a71cd6ce None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:21.782301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2944-1d8c-4093-88f4-73c46ca64f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:21.783689 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2944-1d8c-4093-88f4-73c46ca64f7a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.784044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2944-1d8c-4093-88f4-73c46ca64f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.784385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2944-1d8c-4093-88f4-73c46ca64f7a None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.785475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b2944-1d8c-4093-88f4-73c46ca64f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:21.786401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b2944-1d8c-4093-88f4-73c46ca64f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:21.788267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b2944-1d8c-4093-88f4-73c46ca64f7a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:21.810711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 452/865] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:21.813964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2944-1d8c-4093-88f4-73c46ca64f7a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:21.856658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d662fa-7c1e-4327-9c2a-80b5a71cd6ce None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:21.898267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789353cf-b1d5-457b-a2ce-cb83c9f12e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:21.899508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789353cf-b1d5-457b-a2ce-cb83c9f12e66 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:21.899794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789353cf-b1d5-457b-a2ce-cb83c9f12e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:21.900240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789353cf-b1d5-457b-a2ce-cb83c9f12e66 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:21.900971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789353cf-b1d5-457b-a2ce-cb83c9f12e66 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:21.901279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789353cf-b1d5-457b-a2ce-cb83c9f12e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:21.903567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789353cf-b1d5-457b-a2ce-cb83c9f12e66 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:21.909677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 414/866] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:21.915778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789353cf-b1d5-457b-a2ce-cb83c9f12e66 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:21.929739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:21.963102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2944-1d8c-4093-88f4-73c46ca64f7a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:22.007262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9fbbf-c19c-45a8-bb51-65a1a2aa7127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:22.008169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9fbbf-c19c-45a8-bb51-65a1a2aa7127 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:22.008449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9fbbf-c19c-45a8-bb51-65a1a2aa7127 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:22.008717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9fbbf-c19c-45a8-bb51-65a1a2aa7127 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:22.018548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9fbbf-c19c-45a8-bb51-65a1a2aa7127 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:22.020309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9fbbf-c19c-45a8-bb51-65a1a2aa7127 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-dbe9fbbf-c19c-45a8-bb51-65a1a2aa7127 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:22.036796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:22.037774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:22.038717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:22.038717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:22.038717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:22.038717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:22.038717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:22.038717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:22.038717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:22.038717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:22.038717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 453/867] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:22.043971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9fbbf-c19c-45a8-bb51-65a1a2aa7127 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:22.055984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789353cf-b1d5-457b-a2ce-cb83c9f12e66 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:22.062886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:22.099188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe041-3c11-4c38-a0fd-d116cb566a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:22.100260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe041-3c11-4c38-a0fd-d116cb566a50 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:22.100540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe041-3c11-4c38-a0fd-d116cb566a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:22.100813 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe041-3c11-4c38-a0fd-d116cb566a50 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:22.101528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe041-3c11-4c38-a0fd-d116cb566a50 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:22.101832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe041-3c11-4c38-a0fd-d116cb566a50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:22.103871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe041-3c11-4c38-a0fd-d116cb566a50 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:22.114534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 415/868] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:22.176561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9fbbf-c19c-45a8-bb51-65a1a2aa7127 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:22.215712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c177ac8-9996-4730-b904-a393bda7c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:22.216441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177ac8-9996-4730-b904-a393bda7c859 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:22.216724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177ac8-9996-4730-b904-a393bda7c859 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:22.216995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177ac8-9996-4730-b904-a393bda7c859 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:22.217797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c177ac8-9996-4730-b904-a393bda7c859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:22.218102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c177ac8-9996-4730-b904-a393bda7c859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:22.219604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c177ac8-9996-4730-b904-a393bda7c859 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:22.234426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 454/869] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:22.240397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe041-3c11-4c38-a0fd-d116cb566a50 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:22.322411 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:22.353983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe041-3c11-4c38-a0fd-d116cb566a50 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:22.388453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d854c-866e-4deb-8787-769a01c44b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:22.389113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d854c-866e-4deb-8787-769a01c44b38 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:22.389389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d854c-866e-4deb-8787-769a01c44b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:22.389656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d854c-866e-4deb-8787-769a01c44b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:22.390489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d854c-866e-4deb-8787-769a01c44b38 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=b0c07436108d4a2089a74e7891b849c5) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:22.390829 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d854c-866e-4deb-8787-769a01c44b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:22.392260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d854c-866e-4deb-8787-769a01c44b38 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:22.398978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 416/870] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:22 2022] GET /identity/v3/role_assignments?user.id=b0c07436108d4a2089a74e7891b849c5&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:22.897755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687119eb-4a3c-4ab3-9b77-9111a85e7c93 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:22.898112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687119eb-4a3c-4ab3-9b77-9111a85e7c93 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:22.898216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687119eb-4a3c-4ab3-9b77-9111a85e7c93 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:22.899855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 455/871] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:22.905386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648383be-db46-4e53-adf6-a9e1b08836ca None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:22.905841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648383be-db46-4e53-adf6-a9e1b08836ca None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:22.905944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648383be-db46-4e53-adf6-a9e1b08836ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:22.923237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-648383be-db46-4e53-adf6-a9e1b08836ca None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:22.924428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-648383be-db46-4e53-adf6-a9e1b08836ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:22.991927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 417/872] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:23.014646 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687119eb-4a3c-4ab3-9b77-9111a85e7c93 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:23.098170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:23.155206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687119eb-4a3c-4ab3-9b77-9111a85e7c93 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:23.190271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc43d1-29a2-4b6f-91f0-493eb8b0c9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:23.191059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc43d1-29a2-4b6f-91f0-493eb8b0c9b0 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:23.191245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc43d1-29a2-4b6f-91f0-493eb8b0c9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:23.191519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc43d1-29a2-4b6f-91f0-493eb8b0c9b0 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:23.192257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc43d1-29a2-4b6f-91f0-493eb8b0c9b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:23.193633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc43d1-29a2-4b6f-91f0-493eb8b0c9b0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:23.214689 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 456/873] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:08:23 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:23.956208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea6f14-a908-42e2-98d0-56f6e7a90305 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:23.956707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea6f14-a908-42e2-98d0-56f6e7a90305 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:23.956707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea6f14-a908-42e2-98d0-56f6e7a90305 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:23.958320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 418/874] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:23.963719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41e01-ffad-491e-adf0-742b26b930f7 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:23.964268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41e01-ffad-491e-adf0-742b26b930f7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:23.964779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41e01-ffad-491e-adf0-742b26b930f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:23.981879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-40d41e01-ffad-491e-adf0-742b26b930f7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:23.983416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-40d41e01-ffad-491e-adf0-742b26b930f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:24.057044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 457/875] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:24.080875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea6f14-a908-42e2-98d0-56f6e7a90305 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:24.153759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:24.192035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea6f14-a908-42e2-98d0-56f6e7a90305 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:24.227866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fe0ad-4af5-43eb-9605-f7228ddbaedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:24.228616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fe0ad-4af5-43eb-9605-f7228ddbaedc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:24.228899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fe0ad-4af5-43eb-9605-f7228ddbaedc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:24.229174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fe0ad-4af5-43eb-9605-f7228ddbaedc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:24.241470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fe0ad-4af5-43eb-9605-f7228ddbaedc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-747fe0ad-4af5-43eb-9605-f7228ddbaedc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:24.249835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:24.250854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:24.251710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 419/876] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 10:08:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:24.258617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d41e01-ffad-491e-adf0-742b26b930f7 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:24.269414 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493463-51f9-4d0f-9ee9-6448d00fac30 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:24.269935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493463-51f9-4d0f-9ee9-6448d00fac30 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:24.270217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493463-51f9-4d0f-9ee9-6448d00fac30 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:24.274538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 420/877] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:24.276732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f64561-38e5-46bd-a878-db17405a81e4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:24.277122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f64561-38e5-46bd-a878-db17405a81e4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:24.277560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f64561-38e5-46bd-a878-db17405a81e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:24.297391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-48f64561-38e5-46bd-a878-db17405a81e4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:24.298767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-48f64561-38e5-46bd-a878-db17405a81e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:24.319951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:24.370680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d41e01-ffad-491e-adf0-742b26b930f7 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:24.390616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 421/878] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:24.404571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f64561-38e5-46bd-a878-db17405a81e4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:24.406119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e55f48-3ec2-4dc8-b5c8-c08f3bcf0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:24.406830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e55f48-3ec2-4dc8-b5c8-c08f3bcf0ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:24.407115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e55f48-3ec2-4dc8-b5c8-c08f3bcf0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:24.407435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e55f48-3ec2-4dc8-b5c8-c08f3bcf0ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:24.408544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e55f48-3ec2-4dc8-b5c8-c08f3bcf0ba0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:24.408849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e55f48-3ec2-4dc8-b5c8-c08f3bcf0ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:24.410238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e55f48-3ec2-4dc8-b5c8-c08f3bcf0ba0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:24.419832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 458/879] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 10:08:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:24.425277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e55f48-3ec2-4dc8-b5c8-c08f3bcf0ba0 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:24.474158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:24.524840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f64561-38e5-46bd-a878-db17405a81e4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:24.540784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e55f48-3ec2-4dc8-b5c8-c08f3bcf0ba0 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:24.556684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:24.561757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28526d7a-5327-44aa-b73b-2fca1412636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:24.562467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28526d7a-5327-44aa-b73b-2fca1412636f None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:24.562793 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28526d7a-5327-44aa-b73b-2fca1412636f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:24.563064 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28526d7a-5327-44aa-b73b-2fca1412636f None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:24.563794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28526d7a-5327-44aa-b73b-2fca1412636f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:24.565158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28526d7a-5327-44aa-b73b-2fca1412636f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:24.579148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 422/880] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:08:24 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:08:24.585001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5d81-a707-43dd-9b25-98bd3c4fe715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:24.585824 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5d81-a707-43dd-9b25-98bd3c4fe715 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:24.586114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5d81-a707-43dd-9b25-98bd3c4fe715 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:24.586382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5d81-a707-43dd-9b25-98bd3c4fe715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:24.588152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa270-f78f-4782-ae72-6a2d1cddd163 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:24.588440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa270-f78f-4782-ae72-6a2d1cddd163 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:24.588803 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa270-f78f-4782-ae72-6a2d1cddd163 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:24.594682 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 423/881] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:24.600060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb72a-8e56-41b7-a5b5-66e95222f941 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:24.600348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb72a-8e56-41b7-a5b5-66e95222f941 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:24.600619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb72a-8e56-41b7-a5b5-66e95222f941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:24.601700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc5d81-a707-43dd-9b25-98bd3c4fe715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:24.603270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc5d81-a707-43dd-9b25-98bd3c4fe715 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-0edc5d81-a707-43dd-9b25-98bd3c4fe715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:24.629537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:24.630552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:24.631490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:24.631490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:24.631490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:24.631490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:24.633079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6a0eb72a-8e56-41b7-a5b5-66e95222f941 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:24.634665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6a0eb72a-8e56-41b7-a5b5-66e95222f941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:24.635878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 459/882] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:24.642305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5d81-a707-43dd-9b25-98bd3c4fe715 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:24.730527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 424/883] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:24.748668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eb72a-8e56-41b7-a5b5-66e95222f941 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:24.773858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5d81-a707-43dd-9b25-98bd3c4fe715 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:24.803552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:24.810164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1b560-bc0d-4bad-be9e-5a357327c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:24.810889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1b560-bc0d-4bad-be9e-5a357327c5ca None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:24.811171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1b560-bc0d-4bad-be9e-5a357327c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:24.811447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1b560-bc0d-4bad-be9e-5a357327c5ca None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:24.812179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1b560-bc0d-4bad-be9e-5a357327c5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:24.812487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1b560-bc0d-4bad-be9e-5a357327c5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:24.813879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1b560-bc0d-4bad-be9e-5a357327c5ca None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:24.827252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 460/884] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:24.834627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1b560-bc0d-4bad-be9e-5a357327c5ca None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:24.864476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eb72a-8e56-41b7-a5b5-66e95222f941 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:24.868003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:24.904269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eaaaa-3e2a-4789-9b47-b7258e1fdd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:24.905089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eaaaa-3e2a-4789-9b47-b7258e1fdd59 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:24.905380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eaaaa-3e2a-4789-9b47-b7258e1fdd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:24.905662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eaaaa-3e2a-4789-9b47-b7258e1fdd59 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:24.906332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14eaaaa-3e2a-4789-9b47-b7258e1fdd59 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:24.907763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14eaaaa-3e2a-4789-9b47-b7258e1fdd59 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a14eaaaa-3e2a-4789-9b47-b7258e1fdd59 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:24.922457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:24.924607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:24.926276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 425/885] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:24.930706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eaaaa-3e2a-4789-9b47-b7258e1fdd59 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:24.966966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1b560-bc0d-4bad-be9e-5a357327c5ca None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:25.002864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084973de-c4d2-435c-848f-ad199933bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:25.003783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084973de-c4d2-435c-848f-ad199933bd4a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.004065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084973de-c4d2-435c-848f-ad199933bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.004374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084973de-c4d2-435c-848f-ad199933bd4a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.012325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084973de-c4d2-435c-848f-ad199933bd4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:25.013843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084973de-c4d2-435c-848f-ad199933bd4a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-084973de-c4d2-435c-848f-ad199933bd4a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:25.030758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:25.031787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:25.032771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:25.032771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:25.032771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:25.032771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:25.032771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:25.032771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:25.032771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:25.032771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:25.032771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:25.032771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:25.036996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 461/886] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 10:08:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:25.038319 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084973de-c4d2-435c-848f-ad199933bd4a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:25.047072 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eaaaa-3e2a-4789-9b47-b7258e1fdd59 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:25.060705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:25.088153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dfa55-35ec-4a0f-b4d8-eeef215adefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:25.089360 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dfa55-35ec-4a0f-b4d8-eeef215adefa None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.089892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dfa55-35ec-4a0f-b4d8-eeef215adefa None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.090483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dfa55-35ec-4a0f-b4d8-eeef215adefa None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.091504 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dfa55-35ec-4a0f-b4d8-eeef215adefa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:25.092070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dfa55-35ec-4a0f-b4d8-eeef215adefa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:25.093772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dfa55-35ec-4a0f-b4d8-eeef215adefa None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:25.099577 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 426/887] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 10:08:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:25.106226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dfa55-35ec-4a0f-b4d8-eeef215adefa None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:25.147050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:25.163562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084973de-c4d2-435c-848f-ad199933bd4a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:25.210358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad97111-4128-4839-b85e-621ce22ee522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:25.211846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad97111-4128-4839-b85e-621ce22ee522 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.212287 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad97111-4128-4839-b85e-621ce22ee522 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.213184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad97111-4128-4839-b85e-621ce22ee522 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.214528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad97111-4128-4839-b85e-621ce22ee522 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:25.215041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad97111-4128-4839-b85e-621ce22ee522 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:25.217555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad97111-4128-4839-b85e-621ce22ee522 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:25.236721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dfa55-35ec-4a0f-b4d8-eeef215adefa None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:25.242781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 462/888] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 10:08:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:25.248442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad97111-4128-4839-b85e-621ce22ee522 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:25.283715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684db55-0081-4b38-b3f8-d6adf87ce4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:25.284839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684db55-0081-4b38-b3f8-d6adf87ce4ee None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.285269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684db55-0081-4b38-b3f8-d6adf87ce4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.286542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684db55-0081-4b38-b3f8-d6adf87ce4ee None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.287416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684db55-0081-4b38-b3f8-d6adf87ce4ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:25.287871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684db55-0081-4b38-b3f8-d6adf87ce4ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:25.289386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684db55-0081-4b38-b3f8-d6adf87ce4ee None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:25.295450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 427/889] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 10:08:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:25.297121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776de39-629a-499b-a4d1-8760a72d1593 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.297554 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776de39-629a-499b-a4d1-8760a72d1593 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.297972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776de39-629a-499b-a4d1-8760a72d1593 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.299616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 428/890] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:25.308285 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d994-dee7-4647-86a0-8b5850229392 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.308996 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d994-dee7-4647-86a0-8b5850229392 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.309448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d994-dee7-4647-86a0-8b5850229392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.331483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7429d994-dee7-4647-86a0-8b5850229392 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:25.334088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7429d994-dee7-4647-86a0-8b5850229392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:25.370875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:25.373459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad97111-4128-4839-b85e-621ce22ee522 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:25.417476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595688e-496b-40f5-af98-b74103ba471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:25.418457 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595688e-496b-40f5-af98-b74103ba471e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.418915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595688e-496b-40f5-af98-b74103ba471e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.419421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595688e-496b-40f5-af98-b74103ba471e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.426563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 429/891] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:25.436459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:25.447326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d994-dee7-4647-86a0-8b5850229392 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:25.504601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595688e-496b-40f5-af98-b74103ba471e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:25.506378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595688e-496b-40f5-af98-b74103ba471e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:25.566746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d994-dee7-4647-86a0-8b5850229392 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:25.602098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ead230-1597-4497-8ffb-b77041c139a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:25.603277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ead230-1597-4497-8ffb-b77041c139a5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.603765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ead230-1597-4497-8ffb-b77041c139a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.604239 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ead230-1597-4497-8ffb-b77041c139a5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.605133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ead230-1597-4497-8ffb-b77041c139a5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:25.606823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ead230-1597-4497-8ffb-b77041c139a5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d5ead230-1597-4497-8ffb-b77041c139a5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:25.624431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:25.625521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:08:25.626397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:25.634016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 430/892] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:08:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:25.635214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ead230-1597-4497-8ffb-b77041c139a5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:25.654520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 463/893] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:25 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 10:08:25.657369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595688e-496b-40f5-af98-b74103ba471e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:25.683455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:25.713797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:25.770152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ead230-1597-4497-8ffb-b77041c139a5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:25.792363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595688e-496b-40f5-af98-b74103ba471e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:25.815859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecedda-2ba7-4959-8b9f-c5a5bf1ad0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:25.816829 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecedda-2ba7-4959-8b9f-c5a5bf1ad0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.817290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecedda-2ba7-4959-8b9f-c5a5bf1ad0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.817739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecedda-2ba7-4959-8b9f-c5a5bf1ad0d3 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.818787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecedda-2ba7-4959-8b9f-c5a5bf1ad0d3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:25.819255 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecedda-2ba7-4959-8b9f-c5a5bf1ad0d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:25.820920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecedda-2ba7-4959-8b9f-c5a5bf1ad0d3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:25.832621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 431/894] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:08:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:25.833910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecedda-2ba7-4959-8b9f-c5a5bf1ad0d3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:25.841442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ac640-6d43-4f54-88e3-e7ffb61ab11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:25.842245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ac640-6d43-4f54-88e3-e7ffb61ab11d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.842540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ac640-6d43-4f54-88e3-e7ffb61ab11d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.842817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ac640-6d43-4f54-88e3-e7ffb61ab11d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.853572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ac640-6d43-4f54-88e3-e7ffb61ab11d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:25.855014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ac640-6d43-4f54-88e3-e7ffb61ab11d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-d53ac640-6d43-4f54-88e3-e7ffb61ab11d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:25.877604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:25.878642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:25.879538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:25.879538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:25.879538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:25.879538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:25.883777 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 464/895] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:25.891716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ac640-6d43-4f54-88e3-e7ffb61ab11d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:25.944997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:25.951693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecedda-2ba7-4959-8b9f-c5a5bf1ad0d3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:25.990136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dfe48-c6cf-4517-af31-454b8931e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:25.990873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dfe48-c6cf-4517-af31-454b8931e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:25.991153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dfe48-c6cf-4517-af31-454b8931e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:25.991425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dfe48-c6cf-4517-af31-454b8931e6e2 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:25.992181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dfe48-c6cf-4517-af31-454b8931e6e2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:25.992488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dfe48-c6cf-4517-af31-454b8931e6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:25.993889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dfe48-c6cf-4517-af31-454b8931e6e2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:26.004243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 432/896] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:08:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:26.006060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dfe48-c6cf-4517-af31-454b8931e6e2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:26.015968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:26.024903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ac640-6d43-4f54-88e3-e7ffb61ab11d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:26.064105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb798f-6806-44dd-bf7e-0f0df8643cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:26.065410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb798f-6806-44dd-bf7e-0f0df8643cee None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:26.065922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb798f-6806-44dd-bf7e-0f0df8643cee None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:26.066456 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb798f-6806-44dd-bf7e-0f0df8643cee None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:26.067476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb798f-6806-44dd-bf7e-0f0df8643cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:26.068033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb798f-6806-44dd-bf7e-0f0df8643cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:26.069830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb798f-6806-44dd-bf7e-0f0df8643cee None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:26.084369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 465/897] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:26.090526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb798f-6806-44dd-bf7e-0f0df8643cee None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:26.131769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dfe48-c6cf-4517-af31-454b8931e6e2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:26.180691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ba478-c255-4289-84c0-0bf4149dd4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:26.182189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ba478-c255-4289-84c0-0bf4149dd4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:26.182597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ba478-c255-4289-84c0-0bf4149dd4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:26.182968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ba478-c255-4289-84c0-0bf4149dd4f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:26.184189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ba478-c255-4289-84c0-0bf4149dd4f6 None admin] RBAC: Adding query filter params (interface=public, service_id=b4387352f3e54215a17d8d774144d951, region_id=RegionOne) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:26.184595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ba478-c255-4289-84c0-0bf4149dd4f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:26.187048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ba478-c255-4289-84c0-0bf4149dd4f6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:26.197583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 433/898] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 10:08:26 2022] GET /identity/v3/endpoints?service_id=b4387352f3e54215a17d8d774144d951&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:26.198770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ba478-c255-4289-84c0-0bf4149dd4f6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:26.223216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb798f-6806-44dd-bf7e-0f0df8643cee None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:26.226018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:26.265171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4628-5238-4b5d-bc7a-0336ea757bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:26.266410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4628-5238-4b5d-bc7a-0336ea757bdc None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:26.266909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4628-5238-4b5d-bc7a-0336ea757bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:26.267388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4628-5238-4b5d-bc7a-0336ea757bdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:26.275562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e4628-5238-4b5d-bc7a-0336ea757bdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:26.277608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e4628-5238-4b5d-bc7a-0336ea757bdc None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-f43e4628-5238-4b5d-bc7a-0336ea757bdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:26.297209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:26.298474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:26.299430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:26.299430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:26.299430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:26.299430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:26.299430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:26.299430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:26.299430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:26.299430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:26.302042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 466/899] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:26.307413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4628-5238-4b5d-bc7a-0336ea757bdc None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:26.318480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ba478-c255-4289-84c0-0bf4149dd4f6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:26.325037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:26.363932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901ac9-45ba-45bf-8669-faa722c76c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:26.365086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901ac9-45ba-45bf-8669-faa722c76c58 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:26.365375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901ac9-45ba-45bf-8669-faa722c76c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:26.365648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901ac9-45ba-45bf-8669-faa722c76c58 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:26.366486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54901ac9-45ba-45bf-8669-faa722c76c58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:26.368277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54901ac9-45ba-45bf-8669-faa722c76c58 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:26.380335 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 434/900] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 10:08:26 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:08:26.435869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4628-5238-4b5d-bc7a-0336ea757bdc None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:26.475535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015eab4-db3b-47c0-9b04-406d49cbfa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:26.476590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015eab4-db3b-47c0-9b04-406d49cbfa82 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:26.477094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015eab4-db3b-47c0-9b04-406d49cbfa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:26.477561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015eab4-db3b-47c0-9b04-406d49cbfa82 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:26.478609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015eab4-db3b-47c0-9b04-406d49cbfa82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:26.479125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015eab4-db3b-47c0-9b04-406d49cbfa82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:26.481028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015eab4-db3b-47c0-9b04-406d49cbfa82 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:26.496207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 467/901] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:26.502979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901ac9-45ba-45bf-8669-faa722c76c58 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:26.599742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:26.612832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901ac9-45ba-45bf-8669-faa722c76c58 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:26.655974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f624cc9-4e42-4382-98fb-bdbcba39ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:26.656638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624cc9-4e42-4382-98fb-bdbcba39ed35 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:26.656917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624cc9-4e42-4382-98fb-bdbcba39ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:26.657188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624cc9-4e42-4382-98fb-bdbcba39ed35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:26.658325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f624cc9-4e42-4382-98fb-bdbcba39ed35 None admin] RBAC: Adding query filter params (role.id=74cddf0b8dcb4fc3a1fb0247747d00a8, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=7701ac0e772842e29e9e6903ff551a13) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:26.658672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f624cc9-4e42-4382-98fb-bdbcba39ed35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:26.660107 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f624cc9-4e42-4382-98fb-bdbcba39ed35 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:26.666552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 435/902] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:26 2022] GET /identity/v3/role_assignments?user.id=7701ac0e772842e29e9e6903ff551a13&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=74cddf0b8dcb4fc3a1fb0247747d00a8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:26.761798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a292b-7c03-4fc3-b14a-6e1e9b2cfbc6 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:26.762105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a292b-7c03-4fc3-b14a-6e1e9b2cfbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:26.762290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a292b-7c03-4fc3-b14a-6e1e9b2cfbc6 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:26.763993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 468/903] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:26.769617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6cd5-922e-48a5-8bab-36fa3d0ea697 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:26.769898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6cd5-922e-48a5-8bab-36fa3d0ea697 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:26.770177 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6cd5-922e-48a5-8bab-36fa3d0ea697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:26.788678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-31fd6cd5-922e-48a5-8bab-36fa3d0ea697 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:26.790282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-31fd6cd5-922e-48a5-8bab-36fa3d0ea697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:26.863171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 436/904] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:26.886114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a292b-7c03-4fc3-b14a-6e1e9b2cfbc6 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:26.960329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:26.997765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a292b-7c03-4fc3-b14a-6e1e9b2cfbc6 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:27.033818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233bd9a-8f82-456c-93db-414c6534b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:27.034960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233bd9a-8f82-456c-93db-414c6534b57c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:27.035379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233bd9a-8f82-456c-93db-414c6534b57c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:27.035817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233bd9a-8f82-456c-93db-414c6534b57c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:27.036611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233bd9a-8f82-456c-93db-414c6534b57c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:27.038193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233bd9a-8f82-456c-93db-414c6534b57c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-f233bd9a-8f82-456c-93db-414c6534b57c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:27.051279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:27.052458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:08:27.053542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:27.056111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 469/905] 10.222.0.66 () {56 vars in 1132 bytes} [Wed Jun 22 10:08:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:27.063457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd6cd5-922e-48a5-8bab-36fa3d0ea697 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:27.145891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:27.166165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd6cd5-922e-48a5-8bab-36fa3d0ea697 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:27.209020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb74a86-b2e5-40ab-84ca-60d4c461f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:27.209948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb74a86-b2e5-40ab-84ca-60d4c461f927 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:27.210232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb74a86-b2e5-40ab-84ca-60d4c461f927 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:27.210554 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb74a86-b2e5-40ab-84ca-60d4c461f927 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:27.211548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb74a86-b2e5-40ab-84ca-60d4c461f927 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:27.212006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb74a86-b2e5-40ab-84ca-60d4c461f927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:27.213837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb74a86-b2e5-40ab-84ca-60d4c461f927 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:27.220254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 437/906] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:27.225938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233bd9a-8f82-456c-93db-414c6534b57c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:27.331691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233bd9a-8f82-456c-93db-414c6534b57c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:27.369671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc452636-f27a-4513-92e4-8ec0b51b4b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:27.370349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc452636-f27a-4513-92e4-8ec0b51b4b7c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:27.370658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc452636-f27a-4513-92e4-8ec0b51b4b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:27.370930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc452636-f27a-4513-92e4-8ec0b51b4b7c None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:27.371679 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc452636-f27a-4513-92e4-8ec0b51b4b7c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:27.371983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc452636-f27a-4513-92e4-8ec0b51b4b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:27.373358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc452636-f27a-4513-92e4-8ec0b51b4b7c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:27.379172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 470/907] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:27.379655 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:27.389349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb74a86-b2e5-40ab-84ca-60d4c461f927 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:27.448137 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee519f-83a4-441e-aecd-f38982fd73a0 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:27.449095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee519f-83a4-441e-aecd-f38982fd73a0 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:27.449660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee519f-83a4-441e-aecd-f38982fd73a0 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:27.451577 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 471/908] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:27.457765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe83761-df10-4d7a-93dc-4dc6dc8cdd8e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:27.457765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe83761-df10-4d7a-93dc-4dc6dc8cdd8e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:27.457765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe83761-df10-4d7a-93dc-4dc6dc8cdd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:27.475606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8fe83761-df10-4d7a-93dc-4dc6dc8cdd8e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:27.476801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8fe83761-df10-4d7a-93dc-4dc6dc8cdd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:27.510694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb74a86-b2e5-40ab-84ca-60d4c461f927 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:27.552060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3fb74-08f0-4588-acc3-dd71b0e394f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:27.552731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3fb74-08f0-4588-acc3-dd71b0e394f5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:27.553007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3fb74-08f0-4588-acc3-dd71b0e394f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:27.553275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3fb74-08f0-4588-acc3-dd71b0e394f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:27.554064 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3fb74-08f0-4588-acc3-dd71b0e394f5 None admin] RBAC: Adding query filter params (interface=public, service_id=4522c4b100f54cc1b3f0690092cc1d68, region_id=RegionOne) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:27.554370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3fb74-08f0-4588-acc3-dd71b0e394f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:27.555269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 472/909] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:27.558730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3fb74-08f0-4588-acc3-dd71b0e394f5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:27.563695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 438/910] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 10:08:27 2022] GET /identity/v3/endpoints?service_id=4522c4b100f54cc1b3f0690092cc1d68&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:27.568836 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe83761-df10-4d7a-93dc-4dc6dc8cdd8e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:27.582832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3fb74-08f0-4588-acc3-dd71b0e394f5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:27.596607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:27.688020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe83761-df10-4d7a-93dc-4dc6dc8cdd8e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:27.698844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3fb74-08f0-4588-acc3-dd71b0e394f5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:27.718597 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:27.727322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9dbf9-4054-45a1-aaa1-4460bd15f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:27.728403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9dbf9-4054-45a1-aaa1-4460bd15f6bf None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:27.729128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9dbf9-4054-45a1-aaa1-4460bd15f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:27.729586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9dbf9-4054-45a1-aaa1-4460bd15f6bf None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:27.730765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9dbf9-4054-45a1-aaa1-4460bd15f6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:27.732765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9dbf9-4054-45a1-aaa1-4460bd15f6bf None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:27.737337 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c9bab-fb3a-475c-87e2-ab77bf657926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:27.738116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c9bab-fb3a-475c-87e2-ab77bf657926 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:27.738532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c9bab-fb3a-475c-87e2-ab77bf657926 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:27.738911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c9bab-fb3a-475c-87e2-ab77bf657926 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:27.739739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c9bab-fb3a-475c-87e2-ab77bf657926 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:27.746534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c9bab-fb3a-475c-87e2-ab77bf657926 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:27.747441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 473/911] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 10:08:27 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:08:27.764359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 439/912] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:08:27 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:08:28.549550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5eb8-8990-4fbe-abd2-bcc856f2784f None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:28.550187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5eb8-8990-4fbe-abd2-bcc856f2784f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:28.550187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5eb8-8990-4fbe-abd2-bcc856f2784f None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:28.551844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 474/913] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:28.557586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2927ee2-00e7-4c79-b2fe-246bc9945f7b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:28.558087 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2927ee2-00e7-4c79-b2fe-246bc9945f7b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:28.558173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2927ee2-00e7-4c79-b2fe-246bc9945f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:28.575705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f2927ee2-00e7-4c79-b2fe-246bc9945f7b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:28.576924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f2927ee2-00e7-4c79-b2fe-246bc9945f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:28.648531 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:28.661951 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 440/914] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:28.685826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5eb8-8990-4fbe-abd2-bcc856f2784f None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:28.793223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5eb8-8990-4fbe-abd2-bcc856f2784f None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:28.824134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c60462-fd9c-4403-99db-bbf4ec1b18d3 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:28.824334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c60462-fd9c-4403-99db-bbf4ec1b18d3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:28.824603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c60462-fd9c-4403-99db-bbf4ec1b18d3 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:28.826296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 441/915] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:28.831985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b792-e6f1-4039-8d47-7da7b6e1af02 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:28.832285 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b792-e6f1-4039-8d47-7da7b6e1af02 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:28.832544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b792-e6f1-4039-8d47-7da7b6e1af02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:28.834394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e713-fe2d-46ce-ab63-90479a77cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:28.835254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e713-fe2d-46ce-ab63-90479a77cb2b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:28.835539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e713-fe2d-46ce-ab63-90479a77cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:28.835816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e713-fe2d-46ce-ab63-90479a77cb2b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:28.836482 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0e713-fe2d-46ce-ab63-90479a77cb2b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:28.838027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0e713-fe2d-46ce-ab63-90479a77cb2b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:28.849780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c624b792-e6f1-4039-8d47-7da7b6e1af02 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-b6f0e713-fe2d-46ce-ab63-90479a77cb2b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:28.850860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:28.851933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:08:28.852952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:28.853783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c624b792-e6f1-4039-8d47-7da7b6e1af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:28.853863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 475/916] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:08:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:28.863614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e713-fe2d-46ce-ab63-90479a77cb2b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:28.942176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 442/917] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:28.943959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:28.966281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624b792-e6f1-4039-8d47-7da7b6e1af02 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:29.002782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e713-fe2d-46ce-ab63-90479a77cb2b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:29.042011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2ff20-5ae3-4fcd-afd9-fa773ab8e3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:29.042732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2ff20-5ae3-4fcd-afd9-fa773ab8e3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:29.043097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2ff20-5ae3-4fcd-afd9-fa773ab8e3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:29.043377 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2ff20-5ae3-4fcd-afd9-fa773ab8e3e4 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:29.044095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2ff20-5ae3-4fcd-afd9-fa773ab8e3e4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:29.044399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2ff20-5ae3-4fcd-afd9-fa773ab8e3e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:29.046214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2ff20-5ae3-4fcd-afd9-fa773ab8e3e4 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:29.051868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 476/918] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:08:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:29.058133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2ff20-5ae3-4fcd-afd9-fa773ab8e3e4 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:29.103726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624b792-e6f1-4039-8d47-7da7b6e1af02 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:29.141996 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:29.155239 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f00740-4498-4011-aacc-15e054485f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:29.156457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f00740-4498-4011-aacc-15e054485f5d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:29.156919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f00740-4498-4011-aacc-15e054485f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:29.157402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f00740-4498-4011-aacc-15e054485f5d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:29.172193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f00740-4498-4011-aacc-15e054485f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-91f00740-4498-4011-aacc-15e054485f5d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:29.183574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:29.184592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:29.185469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:29.192640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 443/919] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 10:08:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:29.196172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f00740-4498-4011-aacc-15e054485f5d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:29.199715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2ff20-5ae3-4fcd-afd9-fa773ab8e3e4 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:29.234027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:29.263516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0d96c-9f4b-4b2b-9e56-7878b9a6a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:29.265554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0d96c-9f4b-4b2b-9e56-7878b9a6a6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:29.266051 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0d96c-9f4b-4b2b-9e56-7878b9a6a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:29.266558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0d96c-9f4b-4b2b-9e56-7878b9a6a6b7 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:29.267532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0d96c-9f4b-4b2b-9e56-7878b9a6a6b7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:29.268057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0d96c-9f4b-4b2b-9e56-7878b9a6a6b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:29.270236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0d96c-9f4b-4b2b-9e56-7878b9a6a6b7 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:29.278156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 477/920] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 10:08:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:29.285022 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0d96c-9f4b-4b2b-9e56-7878b9a6a6b7 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:29.339180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f00740-4498-4011-aacc-15e054485f5d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:29.376287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deee836-c6e1-4486-8fcf-5d4b03a4b4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:29.376968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee836-c6e1-4486-8fcf-5d4b03a4b4dd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:29.377252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee836-c6e1-4486-8fcf-5d4b03a4b4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:29.377531 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee836-c6e1-4486-8fcf-5d4b03a4b4dd None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:29.378287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deee836-c6e1-4486-8fcf-5d4b03a4b4dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:29.378626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deee836-c6e1-4486-8fcf-5d4b03a4b4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:29.380119 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deee836-c6e1-4486-8fcf-5d4b03a4b4dd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:29.389571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 444/921] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 10:08:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:29.397469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deee836-c6e1-4486-8fcf-5d4b03a4b4dd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:29.405744 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0d96c-9f4b-4b2b-9e56-7878b9a6a6b7 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:29.449613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2054b-1537-4613-8164-aa43af3953ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:29.450560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2054b-1537-4613-8164-aa43af3953ba None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:29.450855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2054b-1537-4613-8164-aa43af3953ba None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:29.451140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2054b-1537-4613-8164-aa43af3953ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:29.451902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2054b-1537-4613-8164-aa43af3953ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:29.453490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2054b-1537-4613-8164-aa43af3953ba None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:29.456935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:29.482573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 478/922] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 10:08:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:29.530332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deee836-c6e1-4486-8fcf-5d4b03a4b4dd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:29.582952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e5a3-32bf-4d87-8bd6-8133baefab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:29.582952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e5a3-32bf-4d87-8bd6-8133baefab75 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:29.583730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e5a3-32bf-4d87-8bd6-8133baefab75 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:29.583730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e5a3-32bf-4d87-8bd6-8133baefab75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:29.597079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979e5a3-32bf-4d87-8bd6-8133baefab75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:29.598647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979e5a3-32bf-4d87-8bd6-8133baefab75 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3979e5a3-32bf-4d87-8bd6-8133baefab75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:29.619617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:29.620701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:29.622121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:29.622121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:29.622121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:29.622121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:29.622121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 445/923] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:29.636360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2054b-1537-4613-8164-aa43af3953ba None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:29.688881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:29.752306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2054b-1537-4613-8164-aa43af3953ba None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:29.789401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339b9ae-ee68-4fb4-9500-bad1cd494d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:29.790080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339b9ae-ee68-4fb4-9500-bad1cd494d46 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:29.790367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339b9ae-ee68-4fb4-9500-bad1cd494d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:29.790693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339b9ae-ee68-4fb4-9500-bad1cd494d46 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:29.791490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339b9ae-ee68-4fb4-9500-bad1cd494d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:29.791800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339b9ae-ee68-4fb4-9500-bad1cd494d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:29.793298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339b9ae-ee68-4fb4-9500-bad1cd494d46 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:29.806790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 479/924] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:29.812853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e5a3-32bf-4d87-8bd6-8133baefab75 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:29.925452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:29.931838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e5a3-32bf-4d87-8bd6-8133baefab75 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:29.943913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df998e-0121-4703-8709-094041822d31 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:29.944362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df998e-0121-4703-8709-094041822d31 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:29.944814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df998e-0121-4703-8709-094041822d31 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:29.947498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 480/925] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:29.953881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b195e-658c-4e30-8c74-67ebec82452f None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:29.954535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b195e-658c-4e30-8c74-67ebec82452f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:29.955032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b195e-658c-4e30-8c74-67ebec82452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:29.972639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8c1b195e-658c-4e30-8c74-67ebec82452f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:29.973983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8c1b195e-658c-4e30-8c74-67ebec82452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:29.977734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac2643-9667-4d17-aac3-b0325e69800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:29.978576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac2643-9667-4d17-aac3-b0325e69800e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:29.978856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac2643-9667-4d17-aac3-b0325e69800e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:29.979120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac2643-9667-4d17-aac3-b0325e69800e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:29.987454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac2643-9667-4d17-aac3-b0325e69800e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:29.988885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac2643-9667-4d17-aac3-b0325e69800e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-bcac2643-9667-4d17-aac3-b0325e69800e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:30.004035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:30.005503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:30.006828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 446/926] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 10:08:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:30.007823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c622a-0a86-4a09-aafc-948b93a8ef4b None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.007823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c622a-0a86-4a09-aafc-948b93a8ef4b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.007823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c622a-0a86-4a09-aafc-948b93a8ef4b None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.010569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 447/927] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:30.011293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c622a-0a86-4a09-aafc-948b93a8ef4b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:30.065225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 481/928] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:30.066961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc276c9-2a0a-4faf-b27d-0ad8aead390c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.067412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc276c9-2a0a-4faf-b27d-0ad8aead390c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.067830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc276c9-2a0a-4faf-b27d-0ad8aead390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.090612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-2dc276c9-2a0a-4faf-b27d-0ad8aead390c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:30.092160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2dc276c9-2a0a-4faf-b27d-0ad8aead390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:30.129224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:30.135178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c622a-0a86-4a09-aafc-948b93a8ef4b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:30.175024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5255819-e339-4b3a-9163-c880155900e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:30.175759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5255819-e339-4b3a-9163-c880155900e5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.175989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5255819-e339-4b3a-9163-c880155900e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.176579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5255819-e339-4b3a-9163-c880155900e5 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.177171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5255819-e339-4b3a-9163-c880155900e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:30.177437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5255819-e339-4b3a-9163-c880155900e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:30.178844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5255819-e339-4b3a-9163-c880155900e5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:30.186688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 482/929] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:30.186688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc276c9-2a0a-4faf-b27d-0ad8aead390c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:30.204268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 448/930] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 10:08:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:30.206113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5255819-e339-4b3a-9163-c880155900e5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:30.223857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:30.313412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc276c9-2a0a-4faf-b27d-0ad8aead390c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:30.332622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5255819-e339-4b3a-9163-c880155900e5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:30.356359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018a2c3-051e-46ea-83c4-2e612712f17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:30.357181 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018a2c3-051e-46ea-83c4-2e612712f17c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.357459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018a2c3-051e-46ea-83c4-2e612712f17c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.357735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018a2c3-051e-46ea-83c4-2e612712f17c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.358395 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018a2c3-051e-46ea-83c4-2e612712f17c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:30.359816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018a2c3-051e-46ea-83c4-2e612712f17c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-6018a2c3-051e-46ea-83c4-2e612712f17c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:30.372106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:30.373310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:30.374171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 483/931] 10.222.0.66 () {56 vars in 1132 bytes} [Wed Jun 22 10:08:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:30.375081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018a2c3-051e-46ea-83c4-2e612712f17c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:30.375849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59765-7307-477c-b87d-bbc2a679d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:30.376661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59765-7307-477c-b87d-bbc2a679d2ee None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.376935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59765-7307-477c-b87d-bbc2a679d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.377206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59765-7307-477c-b87d-bbc2a679d2ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.390404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f59765-7307-477c-b87d-bbc2a679d2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:30.392366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f59765-7307-477c-b87d-bbc2a679d2ee None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d8f59765-7307-477c-b87d-bbc2a679d2ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:30.414163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:30.415240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:30.416135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:30.416135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:30.416135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:30.416135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:30.416135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 449/932] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:30.417186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:30.419555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59765-7307-477c-b87d-bbc2a679d2ee None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:30.498840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:30.509850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018a2c3-051e-46ea-83c4-2e612712f17c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:30.538485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59765-7307-477c-b87d-bbc2a679d2ee None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:30.551781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976db260-2014-49f8-a983-ff6ca45f8032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:30.552732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976db260-2014-49f8-a983-ff6ca45f8032 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.552995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976db260-2014-49f8-a983-ff6ca45f8032 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.553276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976db260-2014-49f8-a983-ff6ca45f8032 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.553924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976db260-2014-49f8-a983-ff6ca45f8032 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:30.555365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976db260-2014-49f8-a983-ff6ca45f8032 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-976db260-2014-49f8-a983-ff6ca45f8032 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:30.569102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:30.571584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:30.572497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 484/933] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:30.573309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976db260-2014-49f8-a983-ff6ca45f8032 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:30.595014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6a722-a0d1-4f1a-9e06-b957193e7ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:30.595799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6a722-a0d1-4f1a-9e06-b957193e7ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.596155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6a722-a0d1-4f1a-9e06-b957193e7ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.596500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6a722-a0d1-4f1a-9e06-b957193e7ab6 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.597293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6a722-a0d1-4f1a-9e06-b957193e7ab6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:30.597671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6a722-a0d1-4f1a-9e06-b957193e7ab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:30.599184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6a722-a0d1-4f1a-9e06-b957193e7ab6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:30.604739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 450/934] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:30.605660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6a722-a0d1-4f1a-9e06-b957193e7ab6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:30.687295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:30.702701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976db260-2014-49f8-a983-ff6ca45f8032 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:30.743344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6a722-a0d1-4f1a-9e06-b957193e7ab6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:30.751159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fa240-42b6-4a17-a2cf-b35fc2193547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:30.751159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fa240-42b6-4a17-a2cf-b35fc2193547 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.751159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fa240-42b6-4a17-a2cf-b35fc2193547 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.751159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fa240-42b6-4a17-a2cf-b35fc2193547 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.752002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fa240-42b6-4a17-a2cf-b35fc2193547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:30.752002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fa240-42b6-4a17-a2cf-b35fc2193547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:30.752550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fa240-42b6-4a17-a2cf-b35fc2193547 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:30.768628 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 485/935] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:30.769339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fa240-42b6-4a17-a2cf-b35fc2193547 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:30.787112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:30.794780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196a07a-9c2b-41f5-811e-ed204c1e3d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:30.795879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196a07a-9c2b-41f5-811e-ed204c1e3d78 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.796298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196a07a-9c2b-41f5-811e-ed204c1e3d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.796697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196a07a-9c2b-41f5-811e-ed204c1e3d78 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.797557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196a07a-9c2b-41f5-811e-ed204c1e3d78 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:30.798067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196a07a-9c2b-41f5-811e-ed204c1e3d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:30.799936 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196a07a-9c2b-41f5-811e-ed204c1e3d78 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:30.806289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 451/936] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 10:08:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:30.807680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196a07a-9c2b-41f5-811e-ed204c1e3d78 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:30.898227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fa240-42b6-4a17-a2cf-b35fc2193547 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:30.942959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196a07a-9c2b-41f5-811e-ed204c1e3d78 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:30.946704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f75db-204d-476f-9caf-f3657cb7f031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:30.947389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f75db-204d-476f-9caf-f3657cb7f031 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.947671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f75db-204d-476f-9caf-f3657cb7f031 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.947947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f75db-204d-476f-9caf-f3657cb7f031 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.948666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f75db-204d-476f-9caf-f3657cb7f031 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:30.949002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f75db-204d-476f-9caf-f3657cb7f031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:30.950531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f75db-204d-476f-9caf-f3657cb7f031 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:30.957003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 486/937] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:30.957219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f75db-204d-476f-9caf-f3657cb7f031 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:30.976629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:30.989380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238bf5-c661-4a1b-a92a-884b4f953f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:30.990534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238bf5-c661-4a1b-a92a-884b4f953f93 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.990959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238bf5-c661-4a1b-a92a-884b4f953f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.991274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238bf5-c661-4a1b-a92a-884b4f953f93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.999313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd238bf5-c661-4a1b-a92a-884b4f953f93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:31.000776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd238bf5-c661-4a1b-a92a-884b4f953f93 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-dd238bf5-c661-4a1b-a92a-884b4f953f93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:31.016869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:31.017845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:31.018816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:31.018816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:31.018816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:31.018816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:31.018816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:31.018816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:31.018816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:31.018816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:31.023030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 452/938] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:31.023952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238bf5-c661-4a1b-a92a-884b4f953f93 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:31.072029 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f75db-204d-476f-9caf-f3657cb7f031 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:31.098018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:31.116268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f837f12-86b1-407d-b310-1713516c3c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:31.117382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f837f12-86b1-407d-b310-1713516c3c3d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:31.117382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f837f12-86b1-407d-b310-1713516c3c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:31.117593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f837f12-86b1-407d-b310-1713516c3c3d None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:31.118261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f837f12-86b1-407d-b310-1713516c3c3d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:31.118646 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f837f12-86b1-407d-b310-1713516c3c3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:31.120070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f837f12-86b1-407d-b310-1713516c3c3d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:31.126543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 487/939] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 10:08:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:31.126543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f837f12-86b1-407d-b310-1713516c3c3d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:31.158473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238bf5-c661-4a1b-a92a-884b4f953f93 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:31.198794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66dbf6-5dff-41c5-80fd-458fe913380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:31.198794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66dbf6-5dff-41c5-80fd-458fe913380a None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:31.199169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66dbf6-5dff-41c5-80fd-458fe913380a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:31.199467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66dbf6-5dff-41c5-80fd-458fe913380a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:31.200207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66dbf6-5dff-41c5-80fd-458fe913380a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:31.201571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66dbf6-5dff-41c5-80fd-458fe913380a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:31.226908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:31.242607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 453/940] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 10:08:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:31.242607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66dbf6-5dff-41c5-80fd-458fe913380a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:31.261933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f837f12-86b1-407d-b310-1713516c3c3d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:31.314596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ddd2b-7dfa-4792-b4ea-517f71949b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:31.315349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ddd2b-7dfa-4792-b4ea-517f71949b57 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:31.315636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ddd2b-7dfa-4792-b4ea-517f71949b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:31.315915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ddd2b-7dfa-4792-b4ea-517f71949b57 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:31.316794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ddd2b-7dfa-4792-b4ea-517f71949b57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:31.317111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ddd2b-7dfa-4792-b4ea-517f71949b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:31.318667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ddd2b-7dfa-4792-b4ea-517f71949b57 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:31.342984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 488/941] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:31.344409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ddd2b-7dfa-4792-b4ea-517f71949b57 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:31.388903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66dbf6-5dff-41c5-80fd-458fe913380a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:31.404563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:31.444172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651e23c-2c67-4bb3-80e3-5af2ce3d78c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:31.445150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651e23c-2c67-4bb3-80e3-5af2ce3d78c8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:31.445634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651e23c-2c67-4bb3-80e3-5af2ce3d78c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:31.446101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651e23c-2c67-4bb3-80e3-5af2ce3d78c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:31.447325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651e23c-2c67-4bb3-80e3-5af2ce3d78c8 None admin] RBAC: Adding query filter params (interface=public, service_id=0db655fc232942b092a712901127d725, region_id=RegionOne) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:31.447325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651e23c-2c67-4bb3-80e3-5af2ce3d78c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:31.448637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651e23c-2c67-4bb3-80e3-5af2ce3d78c8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:31.456597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 454/942] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 10:08:31 2022] GET /identity/v3/endpoints?service_id=0db655fc232942b092a712901127d725&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:31.462516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651e23c-2c67-4bb3-80e3-5af2ce3d78c8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:31.487853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ddd2b-7dfa-4792-b4ea-517f71949b57 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:31.532152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dd1e6-29d2-4db5-a97b-49e31447f158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:31.533411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd1e6-29d2-4db5-a97b-49e31447f158 None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:31.533706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd1e6-29d2-4db5-a97b-49e31447f158 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:31.533983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd1e6-29d2-4db5-a97b-49e31447f158 None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/7701ac0e772842e29e9e6903ff551a13/roles/74cddf0b8dcb4fc3a1fb0247747d00a8` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:31.536733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dd1e6-29d2-4db5-a97b-49e31447f158 None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=7701ac0e772842e29e9e6903ff551a13, role_id=74cddf0b8dcb4fc3a1fb0247747d00a8)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:31.538316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dd1e6-29d2-4db5-a97b-49e31447f158 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:31.540934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:31.558045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 489/943] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:08:31 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/7701ac0e772842e29e9e6903ff551a13/roles/74cddf0b8dcb4fc3a1fb0247747d00a8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:08:31.595267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651e23c-2c67-4bb3-80e3-5af2ce3d78c8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:31.640601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cba22-b5fd-4048-908b-9b0bb84c144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:31.640601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cba22-b5fd-4048-908b-9b0bb84c144b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:31.640601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cba22-b5fd-4048-908b-9b0bb84c144b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:31.640601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cba22-b5fd-4048-908b-9b0bb84c144b None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:31.641023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cba22-b5fd-4048-908b-9b0bb84c144b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:31.641576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cba22-b5fd-4048-908b-9b0bb84c144b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:31.647891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb40fb-603b-410a-b6fb-165cb735cd0c None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:31.648212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb40fb-603b-410a-b6fb-165cb735cd0c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:31.648441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb40fb-603b-410a-b6fb-165cb735cd0c None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:31.649449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 455/944] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 10:08:31 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:08:31.649813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 490/945] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:31.657106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828d28f-991e-4691-92a7-e56b37380bbe None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:31.657541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828d28f-991e-4691-92a7-e56b37380bbe None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:31.657725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828d28f-991e-4691-92a7-e56b37380bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:31.679618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5828d28f-991e-4691-92a7-e56b37380bbe None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:31.680945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5828d28f-991e-4691-92a7-e56b37380bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:31.720455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:31.768510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 456/946] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:31.792556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb40fb-603b-410a-b6fb-165cb735cd0c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:31.916502 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb40fb-603b-410a-b6fb-165cb735cd0c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:31.953219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724b617-1769-4908-a67a-c00948642749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:31.954145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724b617-1769-4908-a67a-c00948642749 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:31.954599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724b617-1769-4908-a67a-c00948642749 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:31.955049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724b617-1769-4908-a67a-c00948642749 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:31.955975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724b617-1769-4908-a67a-c00948642749 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:31.957631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724b617-1769-4908-a67a-c00948642749 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:31.959196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WARNING keystone.server.flask.common [None req-4724b617-1769-4908-a67a-c00948642749 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 10:08:31.979842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.sql.core [None req-4724b617-1769-4908-a67a-c00948642749 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 10:08:31.979842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 10:08:31.979842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [parameters: {'id': 'a51ce4899d114ac5a2f8fc6187dc474d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 10:08:31.979842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-4724b617-1769-4908-a67a-c00948642749 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a51ce4899d114ac5a2f8fc6187dc474d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a51ce4899d114ac5a2f8fc6187dc474d. Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:08:31.998360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application result.read() Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 22 10:08:31.999500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application yield resource Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise self.value Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application session.commit() Jun 22 10:08:32.000728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self.session.flush() Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application compat.raise_( Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 10:08:32.001970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 10:08:32.002977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application result.read() Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:08:32.003893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [parameters: {'id': 'a51ce4899d114ac5a2f8fc6187dc474d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:32.005019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:32.006108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:32.007186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:32.007186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 22 10:08:32.007186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 22 10:08:32.007186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:32.007186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:32.007186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 22 10:08:32.007186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 22 10:08:32.007186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a51ce4899d114ac5a2f8fc6187dc474d. Jun 22 10:08:32.007186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:32.009620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 491/947] 10.222.0.66 () {60 vars in 1140 bytes} [Wed Jun 22 10:08:31 2022] POST /identity/v3/projects => generated 262 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:32.015494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828d28f-991e-4691-92a7-e56b37380bbe None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:32.121476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828d28f-991e-4691-92a7-e56b37380bbe None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:32.158717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaf10e-bd16-4cf8-b265-155ad26d745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:32.159519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf10e-bd16-4cf8-b265-155ad26d745c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:32.159789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf10e-bd16-4cf8-b265-155ad26d745c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:32.160053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf10e-bd16-4cf8-b265-155ad26d745c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:32.167537 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaf10e-bd16-4cf8-b265-155ad26d745c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:32.168952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaf10e-bd16-4cf8-b265-155ad26d745c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-f5aaf10e-bd16-4cf8-b265-155ad26d745c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:32.182779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:32.185141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:32.187315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:32.187315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:32.187315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:32.187315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:32.187315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:32.187315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:32.187315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:32.187315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:32.187315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 457/948] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:32.190551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724b617-1769-4908-a67a-c00948642749 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:32.244644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:32.301698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724b617-1769-4908-a67a-c00948642749 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:32.341932 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4a5d7-f093-4f12-9ae2-a0a7f8204cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:32.343007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4a5d7-f093-4f12-9ae2-a0a7f8204cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:32.343509 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4a5d7-f093-4f12-9ae2-a0a7f8204cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:32.344005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4a5d7-f093-4f12-9ae2-a0a7f8204cf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:32.344982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4a5d7-f093-4f12-9ae2-a0a7f8204cf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:32.345487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4a5d7-f093-4f12-9ae2-a0a7f8204cf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:32.347374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4a5d7-f093-4f12-9ae2-a0a7f8204cf5 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:32.368591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 492/949] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:33.413756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd560f22-17d2-4379-a2db-0c1ab631cc1e None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:33.414288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd560f22-17d2-4379-a2db-0c1ab631cc1e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:33.414288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd560f22-17d2-4379-a2db-0c1ab631cc1e None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:33.415968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 458/950] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:33.421748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440863d-4193-4a9b-9ce6-12c8ac3c52b7 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:33.422225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440863d-4193-4a9b-9ce6-12c8ac3c52b7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:33.422307 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440863d-4193-4a9b-9ce6-12c8ac3c52b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:33.440448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c440863d-4193-4a9b-9ce6-12c8ac3c52b7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:33.441975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c440863d-4193-4a9b-9ce6-12c8ac3c52b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:33.513811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 493/951] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:33.536862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd560f22-17d2-4379-a2db-0c1ab631cc1e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:33.568465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:33.648057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd560f22-17d2-4379-a2db-0c1ab631cc1e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:33.651075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5273fc-949a-4a3c-a476-14540fb89837 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:33.651368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5273fc-949a-4a3c-a476-14540fb89837 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:33.651642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5273fc-949a-4a3c-a476-14540fb89837 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:33.653347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 494/952] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:33.658866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f392afd-3c88-440e-a419-a4265e8f0b69 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:33.659155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f392afd-3c88-440e-a419-a4265e8f0b69 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:33.659432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f392afd-3c88-440e-a419-a4265e8f0b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:33.683109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-1f392afd-3c88-440e-a419-a4265e8f0b69 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:33.684290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1f392afd-3c88-440e-a419-a4265e8f0b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:33.690585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef899-82fc-49f2-a47f-f4861846b097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:33.691390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef899-82fc-49f2-a47f-f4861846b097 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:33.691670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef899-82fc-49f2-a47f-f4861846b097 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:33.691936 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef899-82fc-49f2-a47f-f4861846b097 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:33.693115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef899-82fc-49f2-a47f-f4861846b097 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:33.694492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef899-82fc-49f2-a47f-f4861846b097 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-457ef899-82fc-49f2-a47f-f4861846b097 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:33.711259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:33.713270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:33.715615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 459/953] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:33.722581 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef899-82fc-49f2-a47f-f4861846b097 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:33.725328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:33.770780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 495/954] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:33.788942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f392afd-3c88-440e-a419-a4265e8f0b69 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:33.812103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:33.820781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef899-82fc-49f2-a47f-f4861846b097 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:33.856487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2946193-a240-4dcd-a8df-9c49a713fa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:33.857163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2946193-a240-4dcd-a8df-9c49a713fa72 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:33.857442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2946193-a240-4dcd-a8df-9c49a713fa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:33.857714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2946193-a240-4dcd-a8df-9c49a713fa72 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:33.858421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2946193-a240-4dcd-a8df-9c49a713fa72 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:33.858767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2946193-a240-4dcd-a8df-9c49a713fa72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:33.860274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2946193-a240-4dcd-a8df-9c49a713fa72 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:33.865594 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 460/955] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:33.866885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1cbf4-3ce9-4066-9967-be9666d38512 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:33.867167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1cbf4-3ce9-4066-9967-be9666d38512 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:33.867440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1cbf4-3ce9-4066-9967-be9666d38512 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:33.868896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 461/956] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:33.871272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1cbf4-3ce9-4066-9967-be9666d38512 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:33.905086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f392afd-3c88-440e-a419-a4265e8f0b69 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:33.940118 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3773a-9659-4d5f-80f2-3c39f3bb57a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:33.940850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3773a-9659-4d5f-80f2-3c39f3bb57a5 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:33.941133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3773a-9659-4d5f-80f2-3c39f3bb57a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:33.941411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3773a-9659-4d5f-80f2-3c39f3bb57a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:33.951762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3773a-9659-4d5f-80f2-3c39f3bb57a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-71f3773a-9659-4d5f-80f2-3c39f3bb57a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:33.959918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:33.960994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:33.961849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 496/957] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 10:08:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:33.962691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77575c5a-bb76-41e3-805a-451b9e1edb0a None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:33.962691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77575c5a-bb76-41e3-805a-451b9e1edb0a None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:33.963157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77575c5a-bb76-41e3-805a-451b9e1edb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:33.981700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-77575c5a-bb76-41e3-805a-451b9e1edb0a None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:33.982901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-77575c5a-bb76-41e3-805a-451b9e1edb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:33.986008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1cbf4-3ce9-4066-9967-be9666d38512 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:34.006820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:34.025695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97559a0c-6919-49e0-9318-548c733d8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:34.026393 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97559a0c-6919-49e0-9318-548c733d8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.026712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97559a0c-6919-49e0-9318-548c733d8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.026970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97559a0c-6919-49e0-9318-548c733d8cb7 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.027754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97559a0c-6919-49e0-9318-548c733d8cb7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:34.028480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97559a0c-6919-49e0-9318-548c733d8cb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:34.030398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97559a0c-6919-49e0-9318-548c733d8cb7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:34.046616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 462/958] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:34.046616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97559a0c-6919-49e0-9318-548c733d8cb7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:34.055954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 497/959] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:34.071608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:34.087789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77575c5a-bb76-41e3-805a-451b9e1edb0a None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:34.186128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97559a0c-6919-49e0-9318-548c733d8cb7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:34.229433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77575c5a-bb76-41e3-805a-451b9e1edb0a None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:34.236972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f55e-1ac3-496d-a1db-c78d40d2938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:34.238426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f55e-1ac3-496d-a1db-c78d40d2938c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.238745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f55e-1ac3-496d-a1db-c78d40d2938c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.239018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f55e-1ac3-496d-a1db-c78d40d2938c None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.239797 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f55e-1ac3-496d-a1db-c78d40d2938c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:34.240126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f55e-1ac3-496d-a1db-c78d40d2938c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:34.242565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f55e-1ac3-496d-a1db-c78d40d2938c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:34.254934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 463/960] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 10:08:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:34.260161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f55e-1ac3-496d-a1db-c78d40d2938c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:34.277610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3947-3401-4eb3-8a89-812656ed74dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:34.279107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3947-3401-4eb3-8a89-812656ed74dd None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.279595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3947-3401-4eb3-8a89-812656ed74dd None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.280061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3947-3401-4eb3-8a89-812656ed74dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.281094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad3947-3401-4eb3-8a89-812656ed74dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:34.284201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad3947-3401-4eb3-8a89-812656ed74dd None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-c7ad3947-3401-4eb3-8a89-812656ed74dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:34.302875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:34.304101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:34.304991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:34.308767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 498/961] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:34.315030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3947-3401-4eb3-8a89-812656ed74dd None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:34.343678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:34.394958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:34.401319 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f55e-1ac3-496d-a1db-c78d40d2938c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:34.425218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3947-3401-4eb3-8a89-812656ed74dd None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:34.448895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489d4b-93c5-443a-a9c8-214718bc67c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:34.450676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489d4b-93c5-443a-a9c8-214718bc67c1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.451376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489d4b-93c5-443a-a9c8-214718bc67c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.452268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489d4b-93c5-443a-a9c8-214718bc67c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.463250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d31190-f764-4905-bd02-68c5c11c3e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:34.463921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31190-f764-4905-bd02-68c5c11c3e1c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.464204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31190-f764-4905-bd02-68c5c11c3e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.464480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31190-f764-4905-bd02-68c5c11c3e1c None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.465422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d31190-f764-4905-bd02-68c5c11c3e1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:34.465619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d31190-f764-4905-bd02-68c5c11c3e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:34.467050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d31190-f764-4905-bd02-68c5c11c3e1c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:34.467973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe489d4b-93c5-443a-a9c8-214718bc67c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:34.470258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe489d4b-93c5-443a-a9c8-214718bc67c1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:34.477457 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 499/962] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 10:08:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:34.478587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d31190-f764-4905-bd02-68c5c11c3e1c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-fe489d4b-93c5-443a-a9c8-214718bc67c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:34.498428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:34.499422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:34.500362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:34.500362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:34.500362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:34.500362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:34.503046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 464/963] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:34.510575 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489d4b-93c5-443a-a9c8-214718bc67c1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:34.582103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:34.595376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d31190-f764-4905-bd02-68c5c11c3e1c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:34.622876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489d4b-93c5-443a-a9c8-214718bc67c1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:34.632552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3edebf-d333-4184-9df2-62eec01b4496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:34.633495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3edebf-d333-4184-9df2-62eec01b4496 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.633958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3edebf-d333-4184-9df2-62eec01b4496 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.634430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3edebf-d333-4184-9df2-62eec01b4496 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.635349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3edebf-d333-4184-9df2-62eec01b4496 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:34.639367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3edebf-d333-4184-9df2-62eec01b4496 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:34.641019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3edebf-d333-4184-9df2-62eec01b4496 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:34.646558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 500/964] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 10:08:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:34.647897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61538-269e-461a-9e8a-3ddea22c399d None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.648183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61538-269e-461a-9e8a-3ddea22c399d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.648458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61538-269e-461a-9e8a-3ddea22c399d None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.653915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 501/965] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:34.653915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc61538-269e-461a-9e8a-3ddea22c399d None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:34.667441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503b5f5-f68e-4acf-9706-bb50c425f083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:34.668259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503b5f5-f68e-4acf-9706-bb50c425f083 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.668621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503b5f5-f68e-4acf-9706-bb50c425f083 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.668961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503b5f5-f68e-4acf-9706-bb50c425f083 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.669753 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503b5f5-f68e-4acf-9706-bb50c425f083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:34.670126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503b5f5-f68e-4acf-9706-bb50c425f083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:34.671536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503b5f5-f68e-4acf-9706-bb50c425f083 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:34.673175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:34.684778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 465/966] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:34.688597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc6cc4-a0b0-471c-a8e4-2949d918e5b6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.689208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc6cc4-a0b0-471c-a8e4-2949d918e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.689733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc6cc4-a0b0-471c-a8e4-2949d918e5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.708678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-14dc6cc4-a0b0-471c-a8e4-2949d918e5b6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:34.709886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-14dc6cc4-a0b0-471c-a8e4-2949d918e5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:34.763623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc61538-269e-461a-9e8a-3ddea22c399d None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:34.780781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 466/967] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:34.781931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc6cc4-a0b0-471c-a8e4-2949d918e5b6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:34.805269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b94f2-a0e6-4295-91e7-b5be8d1ee228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:34.806015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b94f2-a0e6-4295-91e7-b5be8d1ee228 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.806415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b94f2-a0e6-4295-91e7-b5be8d1ee228 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.806824 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b94f2-a0e6-4295-91e7-b5be8d1ee228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.807654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b94f2-a0e6-4295-91e7-b5be8d1ee228 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:34.809228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b94f2-a0e6-4295-91e7-b5be8d1ee228 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:34.831518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 502/968] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 10:08:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:34.840526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b94f2-a0e6-4295-91e7-b5be8d1ee228 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:34.859295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:34.917997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc6cc4-a0b0-471c-a8e4-2949d918e5b6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:34.954679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:34.979240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41b7a7-0959-488e-805f-306e3b012c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:34.980490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41b7a7-0959-488e-805f-306e3b012c91 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:34.981214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41b7a7-0959-488e-805f-306e3b012c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:34.981763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41b7a7-0959-488e-805f-306e3b012c91 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:34.982693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b94f2-a0e6-4295-91e7-b5be8d1ee228 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:34.991910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41b7a7-0959-488e-805f-306e3b012c91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:34.994532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41b7a7-0959-488e-805f-306e3b012c91 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0d41b7a7-0959-488e-805f-306e3b012c91 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:35.012024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:35.013251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:35.014288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 467/969] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 10:08:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:35.019612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41b7a7-0959-488e-805f-306e3b012c91 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:35.029482 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f1659-a9cc-49e0-b341-532c9dd049b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:35.029775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1659-a9cc-49e0-b341-532c9dd049b9 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:35.030172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1659-a9cc-49e0-b341-532c9dd049b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:35.031400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1659-a9cc-49e0-b341-532c9dd049b9 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:35.032229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f1659-a9cc-49e0-b341-532c9dd049b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:35.034432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f1659-a9cc-49e0-b341-532c9dd049b9 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:35.048471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.sql.core [None req-cc4f1659-a9cc-49e0-b341-532c9dd049b9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 10:08:35.048471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 10:08:35.048471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [parameters: {'user_id': '768f2f6584a74ee59b08753157df4215', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 10:08:35.048471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-cc4f1659-a9cc-49e0-b341-532c9dd049b9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application result.read() Jun 22 10:08:35.056498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:08:35.057566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application yield resource Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise self.value Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application session.commit() Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 10:08:35.058827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self.session.flush() Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application compat.raise_( Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 10:08:35.060023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:08:35.061124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application result.read() Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:08:35.062242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [parameters: {'user_id': '768f2f6584a74ee59b08753157df4215', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:35.063298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 22 10:08:35.064298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 22 10:08:35.065859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 22 10:08:35.065859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 22 10:08:35.065859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 10:08:35.065859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 10:08:35.065859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 10:08:35.065859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:35.065859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 503/970] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Jun 22 10:08:34 2022] POST /identity/v3/users => generated 160 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:35.071700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f1659-a9cc-49e0-b341-532c9dd049b9 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:35.139078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:35.139453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41b7a7-0959-488e-805f-306e3b012c91 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:35.177242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387d0a-c6fc-4ef2-aa20-661741e9a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:35.178356 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387d0a-c6fc-4ef2-aa20-661741e9a0ca None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:35.178974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387d0a-c6fc-4ef2-aa20-661741e9a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:35.179333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387d0a-c6fc-4ef2-aa20-661741e9a0ca None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:35.180287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7387d0a-c6fc-4ef2-aa20-661741e9a0ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:35.180600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7387d0a-c6fc-4ef2-aa20-661741e9a0ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:35.182159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7387d0a-c6fc-4ef2-aa20-661741e9a0ca None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:35.182600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f1659-a9cc-49e0-b341-532c9dd049b9 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:35.202674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 468/971] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 10:08:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:35.208552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387d0a-c6fc-4ef2-aa20-661741e9a0ca None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:35.229155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650399b5-6af5-43dc-bb55-bcc035da8407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:35.230021 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650399b5-6af5-43dc-bb55-bcc035da8407 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:35.230349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650399b5-6af5-43dc-bb55-bcc035da8407 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:35.230904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650399b5-6af5-43dc-bb55-bcc035da8407 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:35.239327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650399b5-6af5-43dc-bb55-bcc035da8407 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:35.240984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650399b5-6af5-43dc-bb55-bcc035da8407 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:35.254686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-650399b5-6af5-43dc-bb55-bcc035da8407 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:35.256259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:35.257207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:35.263720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 504/972] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:08:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:35.270635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650399b5-6af5-43dc-bb55-bcc035da8407 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:35.343202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387d0a-c6fc-4ef2-aa20-661741e9a0ca None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:35.376781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650399b5-6af5-43dc-bb55-bcc035da8407 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:35.386179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90c3bc-0e94-4640-a158-104708f35a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:35.386954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90c3bc-0e94-4640-a158-104708f35a9a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:35.387338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90c3bc-0e94-4640-a158-104708f35a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:35.387618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90c3bc-0e94-4640-a158-104708f35a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:35.411010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:35.423481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d232b2-6e37-48a1-944b-3e8064bde463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:35.425016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d232b2-6e37-48a1-944b-3e8064bde463 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:35.425770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d232b2-6e37-48a1-944b-3e8064bde463 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:35.426968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d232b2-6e37-48a1-944b-3e8064bde463 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:35.428650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d232b2-6e37-48a1-944b-3e8064bde463 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:35.429153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d232b2-6e37-48a1-944b-3e8064bde463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:35.431063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d232b2-6e37-48a1-944b-3e8064bde463 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:35.467924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90c3bc-0e94-4640-a158-104708f35a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:35.469381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90c3bc-0e94-4640-a158-104708f35a9a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:35.483493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 505/973] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 10:08:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:35.516740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:35.593808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 469/974] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:35 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:35.597841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d232b2-6e37-48a1-944b-3e8064bde463 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:35.711422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d232b2-6e37-48a1-944b-3e8064bde463 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:35.748506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f092c20-fde4-4b94-9b4b-e0e4b91c3913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:35.749322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092c20-fde4-4b94-9b4b-e0e4b91c3913 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:35.749609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092c20-fde4-4b94-9b4b-e0e4b91c3913 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:35.749890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092c20-fde4-4b94-9b4b-e0e4b91c3913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:35.760906 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f092c20-fde4-4b94-9b4b-e0e4b91c3913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:35.762436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f092c20-fde4-4b94-9b4b-e0e4b91c3913 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-1f092c20-fde4-4b94-9b4b-e0e4b91c3913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:35.780199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:35.781218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:35.782314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:35.782314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:35.782314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:35.782314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:35.782314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 506/975] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:35.788863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90c3bc-0e94-4640-a158-104708f35a9a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:35.891089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90c3bc-0e94-4640-a158-104708f35a9a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:35.927152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6be6e-8e7f-405d-bd7d-f55fc63a03e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:35.927818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6be6e-8e7f-405d-bd7d-f55fc63a03e6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:35.928102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6be6e-8e7f-405d-bd7d-f55fc63a03e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:35.928375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6be6e-8e7f-405d-bd7d-f55fc63a03e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:35.929094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6be6e-8e7f-405d-bd7d-f55fc63a03e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:35.929401 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6be6e-8e7f-405d-bd7d-f55fc63a03e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:35.930799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6be6e-8e7f-405d-bd7d-f55fc63a03e6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:35.937651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:35.945080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 470/976] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:35.950479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f092c20-fde4-4b94-9b4b-e0e4b91c3913 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:35.987245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:36.057690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f092c20-fde4-4b94-9b4b-e0e4b91c3913 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:36.092524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84173cf3-7d73-4d60-9011-22fb7f1fac46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:36.093323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173cf3-7d73-4d60-9011-22fb7f1fac46 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.093606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173cf3-7d73-4d60-9011-22fb7f1fac46 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.093881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173cf3-7d73-4d60-9011-22fb7f1fac46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.101105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84173cf3-7d73-4d60-9011-22fb7f1fac46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:36.102558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84173cf3-7d73-4d60-9011-22fb7f1fac46 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-84173cf3-7d73-4d60-9011-22fb7f1fac46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:36.116631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:36.117586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:36.119033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:36.119033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:36.119033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:36.119033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:36.119033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:36.119033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:36.119033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:36.119033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:36.119890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 507/977] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:36.123681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6be6e-8e7f-405d-bd7d-f55fc63a03e6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:36.164266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8877c-1fd5-4cb4-8de9-14fc4d63fb55 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.164455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8877c-1fd5-4cb4-8de9-14fc4d63fb55 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.164752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8877c-1fd5-4cb4-8de9-14fc4d63fb55 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.166180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 508/978] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:36.171905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef221c4-fdcb-44a4-8c5e-24955821fb0d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.172190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef221c4-fdcb-44a4-8c5e-24955821fb0d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.172461 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef221c4-fdcb-44a4-8c5e-24955821fb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.190765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-fef221c4-fdcb-44a4-8c5e-24955821fb0d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:36.192294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-fef221c4-fdcb-44a4-8c5e-24955821fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:36.238563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6be6e-8e7f-405d-bd7d-f55fc63a03e6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:36.270938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 509/979] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:36.274224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7021d7-36de-4691-a357-ebd72a564c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:36.274925 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7021d7-36de-4691-a357-ebd72a564c39 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.275211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7021d7-36de-4691-a357-ebd72a564c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.275486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7021d7-36de-4691-a357-ebd72a564c39 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.276313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7021d7-36de-4691-a357-ebd72a564c39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:36.276625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7021d7-36de-4691-a357-ebd72a564c39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:36.278076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7021d7-36de-4691-a357-ebd72a564c39 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:36.296650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 471/980] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:36.296848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef221c4-fdcb-44a4-8c5e-24955821fb0d None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:36.299502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7021d7-36de-4691-a357-ebd72a564c39 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:36.324164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:36.359617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:36.401909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7021d7-36de-4691-a357-ebd72a564c39 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:36.403441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef221c4-fdcb-44a4-8c5e-24955821fb0d None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:36.440949 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77b3d8-b655-4c93-bb2c-583f4700a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:36.441589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d725fd-b1a6-471c-8bb9-9a7415243ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:36.441715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77b3d8-b655-4c93-bb2c-583f4700a122 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.441808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d725fd-b1a6-471c-8bb9-9a7415243ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.441889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77b3d8-b655-4c93-bb2c-583f4700a122 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.441961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d725fd-b1a6-471c-8bb9-9a7415243ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.442245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77b3d8-b655-4c93-bb2c-583f4700a122 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.442341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d725fd-b1a6-471c-8bb9-9a7415243ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.442878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77b3d8-b655-4c93-bb2c-583f4700a122 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:36.442976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d725fd-b1a6-471c-8bb9-9a7415243ea3 None admin] RBAC: Adding query filter params (role.id=74cddf0b8dcb4fc3a1fb0247747d00a8, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=7701ac0e772842e29e9e6903ff551a13) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:36.443249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d725fd-b1a6-471c-8bb9-9a7415243ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:36.444273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77b3d8-b655-4c93-bb2c-583f4700a122 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:36.444663 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d725fd-b1a6-471c-8bb9-9a7415243ea3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:36.468120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 510/981] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:08:36 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:36.468340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 472/982] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:36 2022] GET /identity/v3/role_assignments?user.id=7701ac0e772842e29e9e6903ff551a13&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=74cddf0b8dcb4fc3a1fb0247747d00a8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:36.945940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31cac-332e-4309-824e-47df834fa7fd None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.946364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31cac-332e-4309-824e-47df834fa7fd None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.946467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31cac-332e-4309-824e-47df834fa7fd None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.947869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 511/983] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:36.953714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7526-62fd-445d-aa02-30fa24335475 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.954004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7526-62fd-445d-aa02-30fa24335475 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.954307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7526-62fd-445d-aa02-30fa24335475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.972059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8a7d7526-62fd-445d-aa02-30fa24335475 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:36.973259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8a7d7526-62fd-445d-aa02-30fa24335475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:37.057277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 473/984] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:37.080261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d31cac-332e-4309-824e-47df834fa7fd None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:37.173902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:37.193255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d31cac-332e-4309-824e-47df834fa7fd None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:37.229195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd8a6f-a296-4f16-b470-c991135b7cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:37.229931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd8a6f-a296-4f16-b470-c991135b7cec None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:37.230287 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd8a6f-a296-4f16-b470-c991135b7cec None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:37.230589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd8a6f-a296-4f16-b470-c991135b7cec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:37.231252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd8a6f-a296-4f16-b470-c991135b7cec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:37.232645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd8a6f-a296-4f16-b470-c991135b7cec None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-18cd8a6f-a296-4f16-b470-c991135b7cec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:37.245189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:37.246216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:37.251425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 512/985] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:37.254764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d7526-62fd-445d-aa02-30fa24335475 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:37.307735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:37.360573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d7526-62fd-445d-aa02-30fa24335475 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:37.394225 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1d26-25c2-4b50-b313-469c0aae21fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:37.394933 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1d26-25c2-4b50-b313-469c0aae21fc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:37.395214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1d26-25c2-4b50-b313-469c0aae21fc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:37.395480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1d26-25c2-4b50-b313-469c0aae21fc None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:37.396173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1d26-25c2-4b50-b313-469c0aae21fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:37.396494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1d26-25c2-4b50-b313-469c0aae21fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:37.397863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1d26-25c2-4b50-b313-469c0aae21fc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:37.403051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 474/986] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 10:08:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:37.408911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd8a6f-a296-4f16-b470-c991135b7cec None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:37.515848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd8a6f-a296-4f16-b470-c991135b7cec None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:37.550884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45849c43-2ccc-4938-b3fd-d793767c0ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:37.551611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45849c43-2ccc-4938-b3fd-d793767c0ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:37.551899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45849c43-2ccc-4938-b3fd-d793767c0ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:37.552291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45849c43-2ccc-4938-b3fd-d793767c0ac0 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:37.552928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45849c43-2ccc-4938-b3fd-d793767c0ac0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:37.553242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45849c43-2ccc-4938-b3fd-d793767c0ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:37.554756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45849c43-2ccc-4938-b3fd-d793767c0ac0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:37.560356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 513/987] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 10:08:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:37.566701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1d26-25c2-4b50-b313-469c0aae21fc None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:37.679706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1d26-25c2-4b50-b313-469c0aae21fc None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:37.694187 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:37.720331 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31ce08-bbb4-4c1d-9178-2959dd91bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:37.721001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31ce08-bbb4-4c1d-9178-2959dd91bc61 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:37.721629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31ce08-bbb4-4c1d-9178-2959dd91bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:37.721918 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31ce08-bbb4-4c1d-9178-2959dd91bc61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:37.722837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31ce08-bbb4-4c1d-9178-2959dd91bc61 None admin] RBAC: Adding query filter params (interface=admin, service_id=0db655fc232942b092a712901127d725, region_id=RegionOne) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:37.723153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31ce08-bbb4-4c1d-9178-2959dd91bc61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:37.724525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31ce08-bbb4-4c1d-9178-2959dd91bc61 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:37.734490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 475/988] 10.222.0.66 () {56 vars in 1249 bytes} [Wed Jun 22 10:08:37 2022] GET /identity/v3/endpoints?service_id=0db655fc232942b092a712901127d725&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:37.736184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45849c43-2ccc-4938-b3fd-d793767c0ac0 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:37.754125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:37.841574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45849c43-2ccc-4938-b3fd-d793767c0ac0 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:37.874820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1f1ac-a86a-4fb4-beb2-452ae44fb343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:37.875487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f1ac-a86a-4fb4-beb2-452ae44fb343 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:37.875769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f1ac-a86a-4fb4-beb2-452ae44fb343 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:37.876047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f1ac-a86a-4fb4-beb2-452ae44fb343 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:37.876728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1f1ac-a86a-4fb4-beb2-452ae44fb343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:37.878100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1f1ac-a86a-4fb4-beb2-452ae44fb343 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:37.884751 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 514/989] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 10:08:37 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:08:38.525794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1383a-56e6-44f6-8ad2-df0fe49db03f None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:38.526214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1383a-56e6-44f6-8ad2-df0fe49db03f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:38.526316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1383a-56e6-44f6-8ad2-df0fe49db03f None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:38.527947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 476/990] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:38.533413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4341f-de7b-4bfe-bcab-7d8e5ef31695 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:38.533889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4341f-de7b-4bfe-bcab-7d8e5ef31695 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:38.533966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4341f-de7b-4bfe-bcab-7d8e5ef31695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:38.543809 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e7f55-5dc7-45e5-8614-39d0c6e173da None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:38.544098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e7f55-5dc7-45e5-8614-39d0c6e173da None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:38.544367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e7f55-5dc7-45e5-8614-39d0c6e173da None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:38.545741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 477/991] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:38.550863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468f8f7-b0ca-4a95-b51a-88fde734a47d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:38.551082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a6a4341f-de7b-4bfe-bcab-7d8e5ef31695 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:38.551197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468f8f7-b0ca-4a95-b51a-88fde734a47d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:38.551409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468f8f7-b0ca-4a95-b51a-88fde734a47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:38.552207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a6a4341f-de7b-4bfe-bcab-7d8e5ef31695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:38.569613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e468f8f7-b0ca-4a95-b51a-88fde734a47d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:38.570872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e468f8f7-b0ca-4a95-b51a-88fde734a47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:38.627082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 515/992] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:38.649493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4341f-de7b-4bfe-bcab-7d8e5ef31695 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:38.661778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 478/993] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:38.664167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:38.685364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468f8f7-b0ca-4a95-b51a-88fde734a47d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:38.754572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4341f-de7b-4bfe-bcab-7d8e5ef31695 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:38.791106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e312b-3f3f-47c5-a741-6e43efa2e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:38.791830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e312b-3f3f-47c5-a741-6e43efa2e00c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:38.792114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e312b-3f3f-47c5-a741-6e43efa2e00c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:38.792388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e312b-3f3f-47c5-a741-6e43efa2e00c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:38.793239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e312b-3f3f-47c5-a741-6e43efa2e00c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:38.794781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e312b-3f3f-47c5-a741-6e43efa2e00c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:38.796294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468f8f7-b0ca-4a95-b51a-88fde734a47d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:38.804040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-c11e312b-3f3f-47c5-a741-6e43efa2e00c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:38.808205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:38.809234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:38.810085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 516/994] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:38.815377 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e312b-3f3f-47c5-a741-6e43efa2e00c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:38.837435 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f560eb8-beda-4779-a4c7-5a799fc9553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:38.838240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f560eb8-beda-4779-a4c7-5a799fc9553f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:38.838550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f560eb8-beda-4779-a4c7-5a799fc9553f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:38.838832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f560eb8-beda-4779-a4c7-5a799fc9553f None admin] PATH_INFO: `/v3/services/image` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:38.839570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f560eb8-beda-4779-a4c7-5a799fc9553f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:38.840973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f560eb8-beda-4779-a4c7-5a799fc9553f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3f560eb8-beda-4779-a4c7-5a799fc9553f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:38.852985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:38.854083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:38.855070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 479/995] 10.222.0.66 () {56 vars in 1105 bytes} [Wed Jun 22 10:08:38 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:38.860189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f560eb8-beda-4779-a4c7-5a799fc9553f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:38.893217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:38.925633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e312b-3f3f-47c5-a741-6e43efa2e00c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:38.966314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28f6da-d243-4163-afe5-7f20bf9112b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:38.967018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28f6da-d243-4163-afe5-7f20bf9112b9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:38.967305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28f6da-d243-4163-afe5-7f20bf9112b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:38.967582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28f6da-d243-4163-afe5-7f20bf9112b9 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:38.968291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28f6da-d243-4163-afe5-7f20bf9112b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:38.968601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28f6da-d243-4163-afe5-7f20bf9112b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:38.968711 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f560eb8-beda-4779-a4c7-5a799fc9553f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:38.969994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28f6da-d243-4163-afe5-7f20bf9112b9 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:38.978592 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 517/996] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:38.984489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28f6da-d243-4163-afe5-7f20bf9112b9 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:39.009697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f147d7-2b73-4e48-9b8b-fb18b6b8b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:39.010342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f147d7-2b73-4e48-9b8b-fb18b6b8b407 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:39.010661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f147d7-2b73-4e48-9b8b-fb18b6b8b407 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:39.010939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f147d7-2b73-4e48-9b8b-fb18b6b8b407 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:39.011699 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f147d7-2b73-4e48-9b8b-fb18b6b8b407 None admin] RBAC: Adding query filter params (name=image) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:39.011985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f147d7-2b73-4e48-9b8b-fb18b6b8b407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:39.013366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f147d7-2b73-4e48-9b8b-fb18b6b8b407 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:39.018238 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 480/997] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:39.023861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f147d7-2b73-4e48-9b8b-fb18b6b8b407 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:39.063398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:39.101783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28f6da-d243-4163-afe5-7f20bf9112b9 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:39.140118 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda42cf0-d21a-468a-a9d2-0b7a2f63a69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:39.140826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda42cf0-d21a-468a-a9d2-0b7a2f63a69e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:39.141113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda42cf0-d21a-468a-a9d2-0b7a2f63a69e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:39.141396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda42cf0-d21a-468a-a9d2-0b7a2f63a69e None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:39.142123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda42cf0-d21a-468a-a9d2-0b7a2f63a69e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:39.142550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda42cf0-d21a-468a-a9d2-0b7a2f63a69e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:39.143855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda42cf0-d21a-468a-a9d2-0b7a2f63a69e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:39.148355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:39.151366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 518/998] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:39.156127 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f147d7-2b73-4e48-9b8b-fb18b6b8b407 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:39.161972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda42cf0-d21a-468a-a9d2-0b7a2f63a69e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:39.199378 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b840a-893a-4067-abde-1908afa95d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:39.200049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b840a-893a-4067-abde-1908afa95d16 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:39.200333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b840a-893a-4067-abde-1908afa95d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:39.200607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b840a-893a-4067-abde-1908afa95d16 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:39.201319 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b840a-893a-4067-abde-1908afa95d16 None admin] RBAC: Adding query filter params (type=image) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:39.201628 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b840a-893a-4067-abde-1908afa95d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:39.203029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b840a-893a-4067-abde-1908afa95d16 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:39.208067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 481/999] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:39.292774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda42cf0-d21a-468a-a9d2-0b7a2f63a69e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:39.334455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad589cf5-c392-458c-84b0-c55d490d8fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:39.335082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad589cf5-c392-458c-84b0-c55d490d8fab None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:39.335362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad589cf5-c392-458c-84b0-c55d490d8fab None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:39.335637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad589cf5-c392-458c-84b0-c55d490d8fab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:39.336457 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad589cf5-c392-458c-84b0-c55d490d8fab None admin] RBAC: Adding query filter params (interface=public, service_id=e5dbb60634354b97b8ae8809ac0e23e6, region_id=RegionOne) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:39.336764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad589cf5-c392-458c-84b0-c55d490d8fab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:39.338174 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad589cf5-c392-458c-84b0-c55d490d8fab None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:39.344626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 519/1000] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 10:08:39 2022] GET /identity/v3/endpoints?service_id=e5dbb60634354b97b8ae8809ac0e23e6&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:39.350427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b840a-893a-4067-abde-1908afa95d16 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:39.452372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:39.457111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b840a-893a-4067-abde-1908afa95d16 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:39.492275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dfbd1-2b2e-4202-b60b-cf566c2fdc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:39.492946 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dfbd1-2b2e-4202-b60b-cf566c2fdc4e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:39.493224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dfbd1-2b2e-4202-b60b-cf566c2fdc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:39.493495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dfbd1-2b2e-4202-b60b-cf566c2fdc4e None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:39.494183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dfbd1-2b2e-4202-b60b-cf566c2fdc4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:39.495595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dfbd1-2b2e-4202-b60b-cf566c2fdc4e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:39.502361 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 482/1001] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 10:08:39 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:08:39.923495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a32b75-4ec3-437d-8ec6-f27277c8483f None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:39.924002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a32b75-4ec3-437d-8ec6-f27277c8483f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:39.924002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a32b75-4ec3-437d-8ec6-f27277c8483f None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:39.925355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 520/1002] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:39.930750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806489-a1b2-4bb5-9c15-80e29c4ca888 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:39.931197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806489-a1b2-4bb5-9c15-80e29c4ca888 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:39.931294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806489-a1b2-4bb5-9c15-80e29c4ca888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:39.950086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-31806489-a1b2-4bb5-9c15-80e29c4ca888 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:39.952109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-31806489-a1b2-4bb5-9c15-80e29c4ca888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:40.035959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 483/1003] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:40.059052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a32b75-4ec3-437d-8ec6-f27277c8483f None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:40.125418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:40.168710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a32b75-4ec3-437d-8ec6-f27277c8483f None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:40.203436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c206c-dc21-469c-a7e9-390ed204ddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:40.204164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c206c-dc21-469c-a7e9-390ed204ddd7 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:40.204448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c206c-dc21-469c-a7e9-390ed204ddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:40.204719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c206c-dc21-469c-a7e9-390ed204ddd7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:40.205377 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c206c-dc21-469c-a7e9-390ed204ddd7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:40.206787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c206c-dc21-469c-a7e9-390ed204ddd7 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-6e6c206c-dc21-469c-a7e9-390ed204ddd7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:40.218989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:40.220112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:08:40.220988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:40.222830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 521/1004] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 10:08:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:40.226377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806489-a1b2-4bb5-9c15-80e29c4ca888 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:40.326431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:40.338282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806489-a1b2-4bb5-9c15-80e29c4ca888 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:40.375553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f8e89-1e78-42ac-9530-b07904e30659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:40.376262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f8e89-1e78-42ac-9530-b07904e30659 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:40.376524 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f8e89-1e78-42ac-9530-b07904e30659 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:40.376772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f8e89-1e78-42ac-9530-b07904e30659 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:40.377490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f8e89-1e78-42ac-9530-b07904e30659 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:40.377791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f8e89-1e78-42ac-9530-b07904e30659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:40.379215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f8e89-1e78-42ac-9530-b07904e30659 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:40.385463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 484/1005] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 10:08:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:40.391609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c206c-dc21-469c-a7e9-390ed204ddd7 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:40.502877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c206c-dc21-469c-a7e9-390ed204ddd7 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:40.530816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:40.541290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c69ac-df99-470b-bdc9-95ce48d06155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:40.541968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c69ac-df99-470b-bdc9-95ce48d06155 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:40.542254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c69ac-df99-470b-bdc9-95ce48d06155 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:40.542602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c69ac-df99-470b-bdc9-95ce48d06155 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:40.543324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c69ac-df99-470b-bdc9-95ce48d06155 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:40.543634 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c69ac-df99-470b-bdc9-95ce48d06155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:40.545035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c69ac-df99-470b-bdc9-95ce48d06155 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:40.550479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 522/1006] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 10:08:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:40.556270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f8e89-1e78-42ac-9530-b07904e30659 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:40.672280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f8e89-1e78-42ac-9530-b07904e30659 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:40.713172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e9ffc-e8db-452b-8380-6d3f1895963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:40.713848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e9ffc-e8db-452b-8380-6d3f1895963a None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:40.714133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e9ffc-e8db-452b-8380-6d3f1895963a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:40.714477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e9ffc-e8db-452b-8380-6d3f1895963a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:40.715273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e9ffc-e8db-452b-8380-6d3f1895963a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:40.716657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e9ffc-e8db-452b-8380-6d3f1895963a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:40.738599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 485/1007] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 10:08:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:41.278973 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d451-ee69-4eeb-9cb3-f64bea162cb7 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.279518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d451-ee69-4eeb-9cb3-f64bea162cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.279518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d451-ee69-4eeb-9cb3-f64bea162cb7 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.281070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 523/1008] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:41.287099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5725f-ae6b-4970-acc2-15b99f9c3c20 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.287655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5725f-ae6b-4970-acc2-15b99f9c3c20 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.287655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5725f-ae6b-4970-acc2-15b99f9c3c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.305171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-cca5725f-ae6b-4970-acc2-15b99f9c3c20 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:41.306371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cca5725f-ae6b-4970-acc2-15b99f9c3c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:41.318988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:41.386578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 486/1009] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:41 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:41.409952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d451-ee69-4eeb-9cb3-f64bea162cb7 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:41.536951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d451-ee69-4eeb-9cb3-f64bea162cb7 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:41.558564 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402decce-c76c-48ac-b71c-cf3c683d82e6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.558871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402decce-c76c-48ac-b71c-cf3c683d82e6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.559086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402decce-c76c-48ac-b71c-cf3c683d82e6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.562833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 487/1010] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:41.565572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e123089-eaea-499d-bab8-233cf82eacb0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.566090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e123089-eaea-499d-bab8-233cf82eacb0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.566605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e123089-eaea-499d-bab8-233cf82eacb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.577085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6d3e4-19ee-4349-a49e-9748a4289a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:41.577762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6d3e4-19ee-4349-a49e-9748a4289a26 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.578050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6d3e4-19ee-4349-a49e-9748a4289a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.578333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6d3e4-19ee-4349-a49e-9748a4289a26 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.579118 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6d3e4-19ee-4349-a49e-9748a4289a26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:41.580512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6d3e4-19ee-4349-a49e-9748a4289a26 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:41.586803 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4e123089-eaea-499d-bab8-233cf82eacb0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:41.588380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4e123089-eaea-499d-bab8-233cf82eacb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:41.598396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 524/1011] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:08:41 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:41.679708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 488/1012] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:41 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:41.706540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6d3e4-19ee-4349-a49e-9748a4289a26 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:41.772367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:41.832521 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6d3e4-19ee-4349-a49e-9748a4289a26 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:41.883583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7ab77-c8ec-4aaf-a054-f38538d13ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:41.884419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7ab77-c8ec-4aaf-a054-f38538d13ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.884717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7ab77-c8ec-4aaf-a054-f38538d13ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.888952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7ab77-c8ec-4aaf-a054-f38538d13ae6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.888952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7ab77-c8ec-4aaf-a054-f38538d13ae6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:41.888952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7ab77-c8ec-4aaf-a054-f38538d13ae6 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-e6b7ab77-c8ec-4aaf-a054-f38538d13ae6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:41.902531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:41.903609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:08:41.904473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:41.906650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 525/1013] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:41.909121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e123089-eaea-499d-bab8-233cf82eacb0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:41.997441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:42.036978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e123089-eaea-499d-bab8-233cf82eacb0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:42.071612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655af42f-711c-4f26-b596-c60a09ec2b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:42.072310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655af42f-711c-4f26-b596-c60a09ec2b77 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:42.072591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655af42f-711c-4f26-b596-c60a09ec2b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:42.072864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655af42f-711c-4f26-b596-c60a09ec2b77 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:42.073605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655af42f-711c-4f26-b596-c60a09ec2b77 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:42.073942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655af42f-711c-4f26-b596-c60a09ec2b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:42.075364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655af42f-711c-4f26-b596-c60a09ec2b77 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:42.080460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 489/1014] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:42.086773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7ab77-c8ec-4aaf-a054-f38538d13ae6 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:42.202864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7ab77-c8ec-4aaf-a054-f38538d13ae6 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:42.229803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:42.251887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269be89c-9ed2-45f3-a7d8-7fb344affec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:42.252569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269be89c-9ed2-45f3-a7d8-7fb344affec3 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:42.252856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269be89c-9ed2-45f3-a7d8-7fb344affec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:42.253126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269be89c-9ed2-45f3-a7d8-7fb344affec3 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:42.253849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269be89c-9ed2-45f3-a7d8-7fb344affec3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:42.254155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269be89c-9ed2-45f3-a7d8-7fb344affec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:42.255582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269be89c-9ed2-45f3-a7d8-7fb344affec3 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:42.266119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 526/1015] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 10:08:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:42.267809 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655af42f-711c-4f26-b596-c60a09ec2b77 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:42.376627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655af42f-711c-4f26-b596-c60a09ec2b77 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:42.408731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:42.415303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc211a7d-df7c-4404-bcf3-d44071428fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:42.415988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc211a7d-df7c-4404-bcf3-d44071428fd5 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:42.416280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc211a7d-df7c-4404-bcf3-d44071428fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:42.416558 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc211a7d-df7c-4404-bcf3-d44071428fd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:42.417331 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc211a7d-df7c-4404-bcf3-d44071428fd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:42.419394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc211a7d-df7c-4404-bcf3-d44071428fd5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:42.446536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 490/1016] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 10:08:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:42.827757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2f49-7969-42d8-874a-5e979fddaf68 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:42.828409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2f49-7969-42d8-874a-5e979fddaf68 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:42.828409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2f49-7969-42d8-874a-5e979fddaf68 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:42.829664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 527/1017] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:42.835444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db75669-6e3d-4cc7-be2b-ea010ecbcde8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:42.835749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db75669-6e3d-4cc7-be2b-ea010ecbcde8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:42.836023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db75669-6e3d-4cc7-be2b-ea010ecbcde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:42.855020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0db75669-6e3d-4cc7-be2b-ea010ecbcde8 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:42.856272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0db75669-6e3d-4cc7-be2b-ea010ecbcde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:42.936013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 491/1018] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:42.959187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2f49-7969-42d8-874a-5e979fddaf68 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:43.067480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2f49-7969-42d8-874a-5e979fddaf68 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:43.102511 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7759e4-e54e-4f00-9b87-2fcef311e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:43.103330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7759e4-e54e-4f00-9b87-2fcef311e393 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:43.103615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7759e4-e54e-4f00-9b87-2fcef311e393 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:43.103896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7759e4-e54e-4f00-9b87-2fcef311e393 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:43.105484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7759e4-e54e-4f00-9b87-2fcef311e393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:43.106610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7759e4-e54e-4f00-9b87-2fcef311e393 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:43.108421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 528/1019] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:43.114207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db75669-6e3d-4cc7-be2b-ea010ecbcde8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:43.217097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db75669-6e3d-4cc7-be2b-ea010ecbcde8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:43.232416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:43.255198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0091a9b-914d-4ba9-8c05-92175cbf0c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:43.255865 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0091a9b-914d-4ba9-8c05-92175cbf0c2d None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:43.256144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0091a9b-914d-4ba9-8c05-92175cbf0c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:43.256416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0091a9b-914d-4ba9-8c05-92175cbf0c2d None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:43.257129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0091a9b-914d-4ba9-8c05-92175cbf0c2d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:43.258583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0091a9b-914d-4ba9-8c05-92175cbf0c2d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:43.287145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 492/1020] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:08:43 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:43.733967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fd1d8-2656-48eb-bc83-eb56fbaedbb9 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:43.734334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fd1d8-2656-48eb-bc83-eb56fbaedbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:43.734563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fd1d8-2656-48eb-bc83-eb56fbaedbb9 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:43.736190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 529/1021] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:43.741521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02ce1-ef50-419e-9e15-e40f77d68e19 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:43.742006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02ce1-ef50-419e-9e15-e40f77d68e19 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:43.742101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02ce1-ef50-419e-9e15-e40f77d68e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:43.762916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bfd02ce1-ef50-419e-9e15-e40f77d68e19 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:43.764232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bfd02ce1-ef50-419e-9e15-e40f77d68e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:43.852324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 493/1022] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:43.875417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fd1d8-2656-48eb-bc83-eb56fbaedbb9 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:43.930093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:43.983360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fd1d8-2656-48eb-bc83-eb56fbaedbb9 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:44.026104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c03b-0121-4518-9040-522fd04521d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:44.026983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c03b-0121-4518-9040-522fd04521d8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.027263 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c03b-0121-4518-9040-522fd04521d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.027580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c03b-0121-4518-9040-522fd04521d8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.028236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c03b-0121-4518-9040-522fd04521d8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:44.029671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c03b-0121-4518-9040-522fd04521d8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-fd23c03b-0121-4518-9040-522fd04521d8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:44.041780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:44.043073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:08:44.044079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:44.045623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 530/1023] 10.222.0.66 () {56 vars in 1105 bytes} [Wed Jun 22 10:08:43 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:44.049217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd02ce1-ef50-419e-9e15-e40f77d68e19 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:44.156210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:44.165075 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd02ce1-ef50-419e-9e15-e40f77d68e19 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:44.205217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d2acb-ebe3-4b6e-9314-eb1fa40b127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:44.205888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d2acb-ebe3-4b6e-9314-eb1fa40b127b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.206227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d2acb-ebe3-4b6e-9314-eb1fa40b127b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.206538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d2acb-ebe3-4b6e-9314-eb1fa40b127b None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.207344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d2acb-ebe3-4b6e-9314-eb1fa40b127b None admin] RBAC: Adding query filter params (name=image) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:44.207671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d2acb-ebe3-4b6e-9314-eb1fa40b127b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:44.209198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d2acb-ebe3-4b6e-9314-eb1fa40b127b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:44.219445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 494/1024] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:44.220516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c03b-0121-4518-9040-522fd04521d8 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:44.331341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c03b-0121-4518-9040-522fd04521d8 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:44.351497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:44.376267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c412bb9-d3ad-4d68-88b9-37b1ff59b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:44.378876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412bb9-d3ad-4d68-88b9-37b1ff59b678 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.378876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412bb9-d3ad-4d68-88b9-37b1ff59b678 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.378876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412bb9-d3ad-4d68-88b9-37b1ff59b678 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.378876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c412bb9-d3ad-4d68-88b9-37b1ff59b678 None admin] RBAC: Adding query filter params (type=image) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:44.378876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c412bb9-d3ad-4d68-88b9-37b1ff59b678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:44.381872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c412bb9-d3ad-4d68-88b9-37b1ff59b678 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:44.386798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 531/1025] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:44.392812 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d2acb-ebe3-4b6e-9314-eb1fa40b127b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:44.508449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d2acb-ebe3-4b6e-9314-eb1fa40b127b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:44.546322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf2dbd-5b1a-488b-bb44-771b967ac720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:44.547054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2dbd-5b1a-488b-bb44-771b967ac720 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.547342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2dbd-5b1a-488b-bb44-771b967ac720 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.547832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2dbd-5b1a-488b-bb44-771b967ac720 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.548726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf2dbd-5b1a-488b-bb44-771b967ac720 None admin] RBAC: Adding query filter params (interface=public, service_id=5bfdfadfcccd4738828cdbee113534a4, region_id=RegionOne) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:44.549078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf2dbd-5b1a-488b-bb44-771b967ac720 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:44.550814 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf2dbd-5b1a-488b-bb44-771b967ac720 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:44.551262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c925332-308c-462d-8c66-a1a02d3f18b0 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.551549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c925332-308c-462d-8c66-a1a02d3f18b0 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.551826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c925332-308c-462d-8c66-a1a02d3f18b0 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.553392 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 532/1026] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:44.561738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 495/1027] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 10:08:44 2022] GET /identity/v3/endpoints?service_id=5bfdfadfcccd4738828cdbee113534a4&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:44.562580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c925332-308c-462d-8c66-a1a02d3f18b0 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:44.563120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63603-a58d-4fe0-8363-600504fef92f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.563423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63603-a58d-4fe0-8363-600504fef92f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.563730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63603-a58d-4fe0-8363-600504fef92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.580927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-38f63603-a58d-4fe0-8363-600504fef92f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:44.582140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-38f63603-a58d-4fe0-8363-600504fef92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:44.601061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:44.661202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 496/1028] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:44.685066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f63603-a58d-4fe0-8363-600504fef92f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:44.690054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c925332-308c-462d-8c66-a1a02d3f18b0 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:44.729203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575bed7-b813-41ee-9da5-e44aa03e3b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:44.729932 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575bed7-b813-41ee-9da5-e44aa03e3b8b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.730197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575bed7-b813-41ee-9da5-e44aa03e3b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.730475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575bed7-b813-41ee-9da5-e44aa03e3b8b None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.731207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575bed7-b813-41ee-9da5-e44aa03e3b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:44.732586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575bed7-b813-41ee-9da5-e44aa03e3b8b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:44.741166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 533/1029] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 10:08:44 2022] GET /identity/v3/services => generated 1957 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:08:44.800637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f63603-a58d-4fe0-8363-600504fef92f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:44.839259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c635d-0c08-4fd4-a69d-3e17a3acdc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:44.840120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c635d-0c08-4fd4-a69d-3e17a3acdc18 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.840424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c635d-0c08-4fd4-a69d-3e17a3acdc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.840673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c635d-0c08-4fd4-a69d-3e17a3acdc18 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.852671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c635d-0c08-4fd4-a69d-3e17a3acdc18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7d1c635d-0c08-4fd4-a69d-3e17a3acdc18 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:44.861431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:44.862875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:44.863786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 497/1030] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 10:08:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:44.870686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575bed7-b813-41ee-9da5-e44aa03e3b8b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:44.919712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:44.986961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575bed7-b813-41ee-9da5-e44aa03e3b8b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:45.022848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88185f7-1e1f-4570-baff-29cb9235ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:45.023639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88185f7-1e1f-4570-baff-29cb9235ba84 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.023944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88185f7-1e1f-4570-baff-29cb9235ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.024313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88185f7-1e1f-4570-baff-29cb9235ba84 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.025154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88185f7-1e1f-4570-baff-29cb9235ba84 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:45.025461 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88185f7-1e1f-4570-baff-29cb9235ba84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:45.026938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88185f7-1e1f-4570-baff-29cb9235ba84 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:45.037200 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 534/1031] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 10:08:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:45.043475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c635d-0c08-4fd4-a69d-3e17a3acdc18 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:45.062240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:45.161719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c635d-0c08-4fd4-a69d-3e17a3acdc18 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:45.196219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868d5a3-a00c-4d49-a953-73b4f2f12c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:45.197025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868d5a3-a00c-4d49-a953-73b4f2f12c0f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.197302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868d5a3-a00c-4d49-a953-73b4f2f12c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.197569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868d5a3-a00c-4d49-a953-73b4f2f12c0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.208512 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868d5a3-a00c-4d49-a953-73b4f2f12c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:45.209978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868d5a3-a00c-4d49-a953-73b4f2f12c0f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-4868d5a3-a00c-4d49-a953-73b4f2f12c0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:45.227441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:45.228447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:45.235097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:45.235097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:45.235097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:45.235097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:45.235097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 498/1032] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:45.237375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88185f7-1e1f-4570-baff-29cb9235ba84 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:45.353230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88185f7-1e1f-4570-baff-29cb9235ba84 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:45.354783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:45.370319 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac66bf-c028-4d14-8a6a-0b891a0a83b6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.370711 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac66bf-c028-4d14-8a6a-0b891a0a83b6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.370994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac66bf-c028-4d14-8a6a-0b891a0a83b6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.372642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 499/1033] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:45.377438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b8a9c-b71d-4e27-b291-98acebde871c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.377738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b8a9c-b71d-4e27-b291-98acebde871c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.378002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b8a9c-b71d-4e27-b291-98acebde871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.395111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8a9b8a9c-b71d-4e27-b291-98acebde871c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:45.396363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8a9b8a9c-b71d-4e27-b291-98acebde871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:45.396721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220a376-566a-46cb-8676-43ec9bc6393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:45.398158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220a376-566a-46cb-8676-43ec9bc6393a None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.398158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220a376-566a-46cb-8676-43ec9bc6393a None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.398385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220a376-566a-46cb-8676-43ec9bc6393a None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.399427 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220a376-566a-46cb-8676-43ec9bc6393a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:45.400797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220a376-566a-46cb-8676-43ec9bc6393a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:45.402467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220a376-566a-46cb-8676-43ec9bc6393a None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:45.418456 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 535/1034] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:45.424477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220a376-566a-46cb-8676-43ec9bc6393a None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:45.465883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:45.478808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 500/1035] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:45.504435 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b8a9c-b71d-4e27-b291-98acebde871c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:45.544740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220a376-566a-46cb-8676-43ec9bc6393a None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:45.581036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513c497-89cb-431b-a6b1-4b010260ac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:45.582214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513c497-89cb-431b-a6b1-4b010260ac40 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.582732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513c497-89cb-431b-a6b1-4b010260ac40 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.583232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513c497-89cb-431b-a6b1-4b010260ac40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.591047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513c497-89cb-431b-a6b1-4b010260ac40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:45.592645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513c497-89cb-431b-a6b1-4b010260ac40 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-1513c497-89cb-431b-a6b1-4b010260ac40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:45.611041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:45.612265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:45.619079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 536/1036] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 10:08:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:45.619773 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b8a9c-b71d-4e27-b291-98acebde871c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:45.621532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513c497-89cb-431b-a6b1-4b010260ac40 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:45.649679 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:45.666463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4bbdd-a018-416b-8ccd-90aa3309d075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:45.667301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4bbdd-a018-416b-8ccd-90aa3309d075 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.667621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4bbdd-a018-416b-8ccd-90aa3309d075 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.667892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4bbdd-a018-416b-8ccd-90aa3309d075 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.669655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4bbdd-a018-416b-8ccd-90aa3309d075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:45.671529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4bbdd-a018-416b-8ccd-90aa3309d075 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:45.673735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 501/1037] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:45.679159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4bbdd-a018-416b-8ccd-90aa3309d075 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:45.731982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513c497-89cb-431b-a6b1-4b010260ac40 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:45.749395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:45.772806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542ce6-e3c5-44df-9a3f-9015efb463ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:45.773459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542ce6-e3c5-44df-9a3f-9015efb463ff None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.773737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542ce6-e3c5-44df-9a3f-9015efb463ff None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.774257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542ce6-e3c5-44df-9a3f-9015efb463ff None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.774882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a542ce6-e3c5-44df-9a3f-9015efb463ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:45.775220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a542ce6-e3c5-44df-9a3f-9015efb463ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:45.776672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a542ce6-e3c5-44df-9a3f-9015efb463ff None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:45.795309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4bbdd-a018-416b-8ccd-90aa3309d075 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:45.800431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 537/1038] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 10:08:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:45.801571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542ce6-e3c5-44df-9a3f-9015efb463ff None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:45.836940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919493ca-6f96-4d94-a449-4477693831a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:45.837620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919493ca-6f96-4d94-a449-4477693831a5 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.837899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919493ca-6f96-4d94-a449-4477693831a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.838172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919493ca-6f96-4d94-a449-4477693831a5 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.838942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919493ca-6f96-4d94-a449-4477693831a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:45.840445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919493ca-6f96-4d94-a449-4477693831a5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:45.864046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 502/1039] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:08:45 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:08:45.904160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:45.932517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542ce6-e3c5-44df-9a3f-9015efb463ff None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:45.981450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8af05-6ca0-401c-b1be-d7de76070493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:45.982123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8af05-6ca0-401c-b1be-d7de76070493 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.982405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8af05-6ca0-401c-b1be-d7de76070493 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.982720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8af05-6ca0-401c-b1be-d7de76070493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:46.068401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8af05-6ca0-401c-b1be-d7de76070493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:46.069896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8af05-6ca0-401c-b1be-d7de76070493 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:46.164043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:46.192886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 538/1040] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:45 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 10:08:46.194219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919493ca-6f96-4d94-a449-4477693831a5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:46.307035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919493ca-6f96-4d94-a449-4477693831a5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:46.329428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:46.347700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d2c76-8f74-4186-9c88-35482d355aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:46.348603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d2c76-8f74-4186-9c88-35482d355aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:46.348949 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d2c76-8f74-4186-9c88-35482d355aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:46.349257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d2c76-8f74-4186-9c88-35482d355aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:46.361219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d2c76-8f74-4186-9c88-35482d355aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:46.362948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d2c76-8f74-4186-9c88-35482d355aa9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3e5d2c76-8f74-4186-9c88-35482d355aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:46.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:46.383090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:46.384074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:46.384074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:46.384074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:46.384074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:46.384074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 503/1041] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:46.390231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8af05-6ca0-401c-b1be-d7de76070493 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:46.506332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8af05-6ca0-401c-b1be-d7de76070493 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:46.545296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8d557-4b19-42ab-98d8-58759500c064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:46.545969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8d557-4b19-42ab-98d8-58759500c064 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:46.546297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8d557-4b19-42ab-98d8-58759500c064 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:46.546614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8d557-4b19-42ab-98d8-58759500c064 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:46.547354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8d557-4b19-42ab-98d8-58759500c064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:46.547662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8d557-4b19-42ab-98d8-58759500c064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:46.549058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8d557-4b19-42ab-98d8-58759500c064 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:46.566072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 539/1042] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:46.567723 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d2c76-8f74-4186-9c88-35482d355aa9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:46.687632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d2c76-8f74-4186-9c88-35482d355aa9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:46.722432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1b68c-1e3e-4a93-a66c-88623572f4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:46.723269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1b68c-1e3e-4a93-a66c-88623572f4da None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:46.723548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1b68c-1e3e-4a93-a66c-88623572f4da None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:46.723817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1b68c-1e3e-4a93-a66c-88623572f4da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:46.730917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1b68c-1e3e-4a93-a66c-88623572f4da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:46.732372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1b68c-1e3e-4a93-a66c-88623572f4da None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-44e1b68c-1e3e-4a93-a66c-88623572f4da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:46.747065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:46.748049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:46.749003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:46.749003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:46.749003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:46.749003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:46.749003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:46.749003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:46.749003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:46.749003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:46.749003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 504/1043] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:46.755599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8d557-4b19-42ab-98d8-58759500c064 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:46.802713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:46.866091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8d557-4b19-42ab-98d8-58759500c064 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:46.882388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0da33-cb93-487c-af3c-40d04464ccdf None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:46.882943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0da33-cb93-487c-af3c-40d04464ccdf None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:46.882943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0da33-cb93-487c-af3c-40d04464ccdf None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:46.884492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 505/1044] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:46.889266 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698eeae-8ae5-4d61-8c71-094539e0a0b9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:46.889565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698eeae-8ae5-4d61-8c71-094539e0a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:46.889831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698eeae-8ae5-4d61-8c71-094539e0a0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:46.904671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc74f1-f848-411e-ae41-e03dd38f3654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:46.905332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc74f1-f848-411e-ae41-e03dd38f3654 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:46.905600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc74f1-f848-411e-ae41-e03dd38f3654 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:46.905877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc74f1-f848-411e-ae41-e03dd38f3654 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:46.906884 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2698eeae-8ae5-4d61-8c71-094539e0a0b9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:46.906987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc74f1-f848-411e-ae41-e03dd38f3654 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:46.907212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc74f1-f848-411e-ae41-e03dd38f3654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:46.908494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2698eeae-8ae5-4d61-8c71-094539e0a0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:46.909013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc74f1-f848-411e-ae41-e03dd38f3654 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:46.921800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 540/1045] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:46.927786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc74f1-f848-411e-ae41-e03dd38f3654 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:46.937464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:46.985457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 506/1046] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:47.010159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698eeae-8ae5-4d61-8c71-094539e0a0b9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:47.034076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:47.037639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc74f1-f848-411e-ae41-e03dd38f3654 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:47.076937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225480a1-2a87-4f8a-af3a-f963fa4b1957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:47.077636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225480a1-2a87-4f8a-af3a-f963fa4b1957 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:47.077924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225480a1-2a87-4f8a-af3a-f963fa4b1957 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:47.078193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225480a1-2a87-4f8a-af3a-f963fa4b1957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:47.079066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225480a1-2a87-4f8a-af3a-f963fa4b1957 None admin] RBAC: Adding query filter params (role.id=74cddf0b8dcb4fc3a1fb0247747d00a8, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=f91c2e9ae8844d9181aff785c02cf3be) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:47.079374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225480a1-2a87-4f8a-af3a-f963fa4b1957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:47.080817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225480a1-2a87-4f8a-af3a-f963fa4b1957 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:47.087150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 541/1047] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:46 2022] GET /identity/v3/role_assignments?user.id=f91c2e9ae8844d9181aff785c02cf3be&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=74cddf0b8dcb4fc3a1fb0247747d00a8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:47.126118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698eeae-8ae5-4d61-8c71-094539e0a0b9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:47.166294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fecbe1-9809-46ca-99df-1f511fafe63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:47.167139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fecbe1-9809-46ca-99df-1f511fafe63f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:47.167472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fecbe1-9809-46ca-99df-1f511fafe63f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:47.167741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fecbe1-9809-46ca-99df-1f511fafe63f None admin] PATH_INFO: `/v3/services/image` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:47.168420 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fecbe1-9809-46ca-99df-1f511fafe63f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:47.169865 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fecbe1-9809-46ca-99df-1f511fafe63f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-40fecbe1-9809-46ca-99df-1f511fafe63f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:47.182541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:47.183798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:47.189851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 507/1048] 10.222.0.66 () {56 vars in 1105 bytes} [Wed Jun 22 10:08:47 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:47.192584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225480a1-2a87-4f8a-af3a-f963fa4b1957 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:47.303152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225480a1-2a87-4f8a-af3a-f963fa4b1957 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:47.339260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2a76-1f76-49a9-9288-6a31485dcd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:47.339951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2a76-1f76-49a9-9288-6a31485dcd95 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:47.340232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2a76-1f76-49a9-9288-6a31485dcd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:47.340506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2a76-1f76-49a9-9288-6a31485dcd95 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:47.341231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f2a76-1f76-49a9-9288-6a31485dcd95 None admin] RBAC: Adding query filter params (name=image) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:47.341540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f2a76-1f76-49a9-9288-6a31485dcd95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:47.342935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f2a76-1f76-49a9-9288-6a31485dcd95 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:47.352717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 542/1049] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:47.353717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fecbe1-9809-46ca-99df-1f511fafe63f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:47.382856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:47.462259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fecbe1-9809-46ca-99df-1f511fafe63f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:47.498647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7411ee6-8094-44d5-90f5-01909073502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:47.499315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7411ee6-8094-44d5-90f5-01909073502e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:47.499592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7411ee6-8094-44d5-90f5-01909073502e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:47.499862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7411ee6-8094-44d5-90f5-01909073502e None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:47.500569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7411ee6-8094-44d5-90f5-01909073502e None admin] RBAC: Adding query filter params (type=image) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:47.500872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7411ee6-8094-44d5-90f5-01909073502e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:47.502235 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7411ee6-8094-44d5-90f5-01909073502e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:47.507701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 508/1050] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:47.513445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2a76-1f76-49a9-9288-6a31485dcd95 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:47.544981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:47.624956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2a76-1f76-49a9-9288-6a31485dcd95 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:47.665847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc9a27-ccb8-4510-ac42-de8ea31255a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:47.666530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc9a27-ccb8-4510-ac42-de8ea31255a3 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:47.666812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc9a27-ccb8-4510-ac42-de8ea31255a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:47.667089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc9a27-ccb8-4510-ac42-de8ea31255a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:47.667906 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc9a27-ccb8-4510-ac42-de8ea31255a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:47.669284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc9a27-ccb8-4510-ac42-de8ea31255a3 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:47.689032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 543/1051] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 10:08:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:08:47.974734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5473-81e5-4e10-8a00-4ac85d76f6f8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:47.975280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5473-81e5-4e10-8a00-4ac85d76f6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:47.975280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5473-81e5-4e10-8a00-4ac85d76f6f8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:47.976858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 509/1052] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:47.982306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a366-a2a6-4491-ad2b-68c558f46a26 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:47.982599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a366-a2a6-4491-ad2b-68c558f46a26 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:47.982878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a366-a2a6-4491-ad2b-68c558f46a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:48.000255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-5504a366-a2a6-4491-ad2b-68c558f46a26 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:48.001432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5504a366-a2a6-4491-ad2b-68c558f46a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:48.077471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 544/1053] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:48.100429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b5473-81e5-4e10-8a00-4ac85d76f6f8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:48.198705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:48.211449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b5473-81e5-4e10-8a00-4ac85d76f6f8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:48.247102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4f4ea-846d-4398-9165-f92f34f10eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:48.248141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f4ea-846d-4398-9165-f92f34f10eeb None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:48.248591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f4ea-846d-4398-9165-f92f34f10eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:48.249034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f4ea-846d-4398-9165-f92f34f10eeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:48.261572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4f4ea-846d-4398-9165-f92f34f10eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b3c4f4ea-846d-4398-9165-f92f34f10eeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:48.269589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:48.270767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:48.271659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:48.274660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 510/1054] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:48.278196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a366-a2a6-4491-ad2b-68c558f46a26 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:48.291626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:48.383937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a366-a2a6-4491-ad2b-68c558f46a26 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:48.421001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591c3f8-7919-4e9b-9b71-0a2b37c50812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:48.421673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591c3f8-7919-4e9b-9b71-0a2b37c50812 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:48.421940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591c3f8-7919-4e9b-9b71-0a2b37c50812 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:48.422235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591c3f8-7919-4e9b-9b71-0a2b37c50812 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:48.423027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591c3f8-7919-4e9b-9b71-0a2b37c50812 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:48.423341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591c3f8-7919-4e9b-9b71-0a2b37c50812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:48.424754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591c3f8-7919-4e9b-9b71-0a2b37c50812 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:48.433942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 545/1055] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:08:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:48.439719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4f4ea-846d-4398-9165-f92f34f10eeb None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:48.545021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4f4ea-846d-4398-9165-f92f34f10eeb None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:48.580090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130e8a-6bac-4670-a5a8-8a25cc0c8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:48.580970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130e8a-6bac-4670-a5a8-8a25cc0c8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:48.581254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130e8a-6bac-4670-a5a8-8a25cc0c8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:48.581530 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130e8a-6bac-4670-a5a8-8a25cc0c8cb2 None admin] PATH_INFO: `/v3/users/d7dd540856bf4e06aafe215440787072` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:48.595338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9130e8a-6bac-4670-a5a8-8a25cc0c8cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=d7dd540856bf4e06aafe215440787072)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:48.596797 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9130e8a-6bac-4670-a5a8-8a25cc0c8cb2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:48.598691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 511/1056] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:08:48 2022] GET /identity/v3/users/d7dd540856bf4e06aafe215440787072 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:48.604288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591c3f8-7919-4e9b-9b71-0a2b37c50812 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:48.688609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:48.723816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591c3f8-7919-4e9b-9b71-0a2b37c50812 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:48.759875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff387607-f34f-4e84-a323-26a1c91ff562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:48.760634 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff387607-f34f-4e84-a323-26a1c91ff562 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:48.760970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff387607-f34f-4e84-a323-26a1c91ff562 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:48.761281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff387607-f34f-4e84-a323-26a1c91ff562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:48.837013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff387607-f34f-4e84-a323-26a1c91ff562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:48.838426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff387607-f34f-4e84-a323-26a1c91ff562 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:48.911893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:48.949087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 546/1057] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 10:08:48.955301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130e8a-6bac-4670-a5a8-8a25cc0c8cb2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:48.967379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:49.061214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130e8a-6bac-4670-a5a8-8a25cc0c8cb2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:49.098165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc78fb-06f4-4036-8585-0329d7da524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:49.099084 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc78fb-06f4-4036-8585-0329d7da524f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:49.099412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc78fb-06f4-4036-8585-0329d7da524f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:49.099719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc78fb-06f4-4036-8585-0329d7da524f None admin] PATH_INFO: `/v3/projects/433d35727dc04fbe9f0416d731cec17e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:49.101084 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc78fb-06f4-4036-8585-0329d7da524f None admin] RBAC: Authorizing `identity:get_project(project_id=433d35727dc04fbe9f0416d731cec17e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:49.102687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc78fb-06f4-4036-8585-0329d7da524f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:49.104708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 512/1058] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:08:48 2022] GET /identity/v3/projects/433d35727dc04fbe9f0416d731cec17e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:49.110261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eb387-4728-4278-9481-cb6eac8602f3 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:49.110759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc78fb-06f4-4036-8585-0329d7da524f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:49.110856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eb387-4728-4278-9481-cb6eac8602f3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:49.110856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eb387-4728-4278-9481-cb6eac8602f3 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:49.112323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 547/1059] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:49.117306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac76c0-9569-42b0-90d6-18fd2fa2472c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:49.117595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac76c0-9569-42b0-90d6-18fd2fa2472c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:49.117871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac76c0-9569-42b0-90d6-18fd2fa2472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:49.134421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d4ac76c0-9569-42b0-90d6-18fd2fa2472c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:49.135618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d4ac76c0-9569-42b0-90d6-18fd2fa2472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:49.193903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:49.211181 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 548/1060] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:49.219367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc78fb-06f4-4036-8585-0329d7da524f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:49.236088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac76c0-9569-42b0-90d6-18fd2fa2472c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:49.255700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387550d-7d36-4553-a832-fae124d4d6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:49.256397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387550d-7d36-4553-a832-fae124d4d6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:49.256677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387550d-7d36-4553-a832-fae124d4d6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:49.256950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387550d-7d36-4553-a832-fae124d4d6e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:49.257858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387550d-7d36-4553-a832-fae124d4d6e8 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=433d35727dc04fbe9f0416d731cec17e, user.id=d7dd540856bf4e06aafe215440787072) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:49.258182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387550d-7d36-4553-a832-fae124d4d6e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:49.259715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387550d-7d36-4553-a832-fae124d4d6e8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:49.270701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 513/1061] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:49 2022] GET /identity/v3/role_assignments?user.id=d7dd540856bf4e06aafe215440787072&scope.project.id=433d35727dc04fbe9f0416d731cec17e&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:49.353130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac76c0-9569-42b0-90d6-18fd2fa2472c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:49.354880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:49.392274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88068b34-a876-408c-a548-6e7314783914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:49.393124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88068b34-a876-408c-a548-6e7314783914 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:49.393402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88068b34-a876-408c-a548-6e7314783914 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:49.393676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88068b34-a876-408c-a548-6e7314783914 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:49.406182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88068b34-a876-408c-a548-6e7314783914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-88068b34-a876-408c-a548-6e7314783914 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:49.414990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:49.416040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:49.416952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 549/1062] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 10:08:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:49.423039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387550d-7d36-4553-a832-fae124d4d6e8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:49.535001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387550d-7d36-4553-a832-fae124d4d6e8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:49.571172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350684b-2a99-46c5-a67a-3b45b84949c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:49.571851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350684b-2a99-46c5-a67a-3b45b84949c8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:49.572136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350684b-2a99-46c5-a67a-3b45b84949c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:49.572409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350684b-2a99-46c5-a67a-3b45b84949c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:49.573160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350684b-2a99-46c5-a67a-3b45b84949c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:49.573573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350684b-2a99-46c5-a67a-3b45b84949c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:49.575129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350684b-2a99-46c5-a67a-3b45b84949c8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:49.586900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 514/1063] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 10:08:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:49.590963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88068b34-a876-408c-a548-6e7314783914 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:49.700543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88068b34-a876-408c-a548-6e7314783914 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:49.738654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b839-2368-4026-b23c-b6d811cdbe1d None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:49.738989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b839-2368-4026-b23c-b6d811cdbe1d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:49.739204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b839-2368-4026-b23c-b6d811cdbe1d None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:49.740585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 515/1064] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:49.741547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a686ba-6a95-42ff-a2a0-35187b2708f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:49.742349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a686ba-6a95-42ff-a2a0-35187b2708f5 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:49.742668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a686ba-6a95-42ff-a2a0-35187b2708f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:49.742939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a686ba-6a95-42ff-a2a0-35187b2708f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:49.745788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676660-2d72-4ade-a96e-37be8ba5ec4a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:49.746073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676660-2d72-4ade-a96e-37be8ba5ec4a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:49.746354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676660-2d72-4ade-a96e-37be8ba5ec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:49.751424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:49.755770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a686ba-6a95-42ff-a2a0-35187b2708f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:49.757233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a686ba-6a95-42ff-a2a0-35187b2708f5 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:49.763815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c2676660-2d72-4ade-a96e-37be8ba5ec4a None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:49.765007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c2676660-2d72-4ade-a96e-37be8ba5ec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-29a686ba-6a95-42ff-a2a0-35187b2708f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:49.775170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:49.776309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:49.777308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:49.777308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:49.777308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:49.777308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:49.777308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 550/1065] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:49.782230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a686ba-6a95-42ff-a2a0-35187b2708f5 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:49.803115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:49.853270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 516/1066] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:08:49.875617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676660-2d72-4ade-a96e-37be8ba5ec4a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:49.904006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a686ba-6a95-42ff-a2a0-35187b2708f5 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:49.940074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0746cec-542c-4de1-8148-fb5da37ec6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:49.940747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746cec-542c-4de1-8148-fb5da37ec6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:49.941030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746cec-542c-4de1-8148-fb5da37ec6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:49.941309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746cec-542c-4de1-8148-fb5da37ec6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:49.942069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0746cec-542c-4de1-8148-fb5da37ec6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:49.942376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0746cec-542c-4de1-8148-fb5da37ec6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:49.943799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0746cec-542c-4de1-8148-fb5da37ec6a5 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:49.956723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 551/1067] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:49.962249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0746cec-542c-4de1-8148-fb5da37ec6a5 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:49.990331 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676660-2d72-4ade-a96e-37be8ba5ec4a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:50.023646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:50.030310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e3e41-539e-46db-8f05-9ce91ddb762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:50.031024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e3e41-539e-46db-8f05-9ce91ddb762b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.031311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e3e41-539e-46db-8f05-9ce91ddb762b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.031582 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e3e41-539e-46db-8f05-9ce91ddb762b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.045595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:50.075268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0746cec-542c-4de1-8148-fb5da37ec6a5 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:50.107214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e3e41-539e-46db-8f05-9ce91ddb762b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:50.108680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e3e41-539e-46db-8f05-9ce91ddb762b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:50.117096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236e3dc-bd30-4e8d-8529-11dcf55115fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:50.117911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236e3dc-bd30-4e8d-8529-11dcf55115fd None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.118198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236e3dc-bd30-4e8d-8529-11dcf55115fd None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.118481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236e3dc-bd30-4e8d-8529-11dcf55115fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.126850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236e3dc-bd30-4e8d-8529-11dcf55115fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:50.128766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236e3dc-bd30-4e8d-8529-11dcf55115fd None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-4236e3dc-bd30-4e8d-8529-11dcf55115fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:50.143921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:50.144909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 552/1068] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 10:08:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:50.151210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236e3dc-bd30-4e8d-8529-11dcf55115fd None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:50.220491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 517/1069] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 10:08:50.222005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e3e41-539e-46db-8f05-9ce91ddb762b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:50.254079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:50.259938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236e3dc-bd30-4e8d-8529-11dcf55115fd None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:50.296667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e695c-f9b8-4abb-a9bd-8251c3da84a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:50.297353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e695c-f9b8-4abb-a9bd-8251c3da84a7 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.297638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e695c-f9b8-4abb-a9bd-8251c3da84a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.297922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e695c-f9b8-4abb-a9bd-8251c3da84a7 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.298822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e695c-f9b8-4abb-a9bd-8251c3da84a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:50.299127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e695c-f9b8-4abb-a9bd-8251c3da84a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:50.300648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e695c-f9b8-4abb-a9bd-8251c3da84a7 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:50.302701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:50.324522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 553/1070] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 10:08:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:50.325627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e695c-f9b8-4abb-a9bd-8251c3da84a7 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:50.342237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e3e41-539e-46db-8f05-9ce91ddb762b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:50.381867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eba2d-17df-4bc2-905a-fb224824b647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:50.383013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eba2d-17df-4bc2-905a-fb224824b647 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.383577 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eba2d-17df-4bc2-905a-fb224824b647 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.384026 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eba2d-17df-4bc2-905a-fb224824b647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.396318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eba2d-17df-4bc2-905a-fb224824b647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:50.397784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eba2d-17df-4bc2-905a-fb224824b647 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-837eba2d-17df-4bc2-905a-fb224824b647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:50.417846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:50.418875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:50.425105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:50.425105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:50.425105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:50.425105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:50.425105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 518/1071] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:50.427242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eba2d-17df-4bc2-905a-fb224824b647 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:50.440840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e695c-f9b8-4abb-a9bd-8251c3da84a7 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:50.476421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ba67-e13b-4c75-877f-fceb9642e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:50.477201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ba67-e13b-4c75-877f-fceb9642e781 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.477516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ba67-e13b-4c75-877f-fceb9642e781 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.477796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ba67-e13b-4c75-877f-fceb9642e781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.488726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8ba67-e13b-4c75-877f-fceb9642e781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:50.490196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8ba67-e13b-4c75-877f-fceb9642e781 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-4ab8ba67-e13b-4c75-877f-fceb9642e781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:50.508764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:50.509753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:50.511193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:50.511193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:50.511193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:50.511193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:50.511193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 554/1072] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:50.515663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ba67-e13b-4c75-877f-fceb9642e781 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:50.519086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:50.539092 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eba2d-17df-4bc2-905a-fb224824b647 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:50.570808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:50.582642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cb9a5-cf2c-48d6-87f5-7c89bcfa3cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:50.583463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cb9a5-cf2c-48d6-87f5-7c89bcfa3cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.584058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cb9a5-cf2c-48d6-87f5-7c89bcfa3cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.584342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cb9a5-cf2c-48d6-87f5-7c89bcfa3cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.585338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cb9a5-cf2c-48d6-87f5-7c89bcfa3cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:50.585648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cb9a5-cf2c-48d6-87f5-7c89bcfa3cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:50.587788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cb9a5-cf2c-48d6-87f5-7c89bcfa3cf0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:50.614533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 519/1073] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:50.633379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ba67-e13b-4c75-877f-fceb9642e781 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:50.673916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff552a-e58c-418e-b2e3-646e890d412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:50.674631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff552a-e58c-418e-b2e3-646e890d412f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.674915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff552a-e58c-418e-b2e3-646e890d412f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.675187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff552a-e58c-418e-b2e3-646e890d412f None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.675930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff552a-e58c-418e-b2e3-646e890d412f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:50.676236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff552a-e58c-418e-b2e3-646e890d412f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:50.677637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff552a-e58c-418e-b2e3-646e890d412f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:50.695729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 555/1074] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:50.696611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cb9a5-cf2c-48d6-87f5-7c89bcfa3cf0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:50.810316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cb9a5-cf2c-48d6-87f5-7c89bcfa3cf0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:50.845795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143586f8-8fa4-4966-add3-234d50145c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:50.846633 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143586f8-8fa4-4966-add3-234d50145c5e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.846922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143586f8-8fa4-4966-add3-234d50145c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.847193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143586f8-8fa4-4966-add3-234d50145c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.854392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143586f8-8fa4-4966-add3-234d50145c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:50.856033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143586f8-8fa4-4966-add3-234d50145c5e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-143586f8-8fa4-4966-add3-234d50145c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:50.870700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:50.871681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:50.873010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:50.873010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:50.873010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:50.873010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:50.873010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:50.873010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:50.873010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:50.873010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:50.873010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 520/1075] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:50.877854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff552a-e58c-418e-b2e3-646e890d412f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:50.977245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff552a-e58c-418e-b2e3-646e890d412f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:50.979595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:51.011529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1a686-009a-42a8-9b27-55750bc39d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:51.012191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1a686-009a-42a8-9b27-55750bc39d6f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:51.012475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1a686-009a-42a8-9b27-55750bc39d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:51.012747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1a686-009a-42a8-9b27-55750bc39d6f None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:51.013538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1a686-009a-42a8-9b27-55750bc39d6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:51.013847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1a686-009a-42a8-9b27-55750bc39d6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:51.015304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1a686-009a-42a8-9b27-55750bc39d6f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:51.027571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 556/1076] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:51.034019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143586f8-8fa4-4966-add3-234d50145c5e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:51.038257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:51.140364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143586f8-8fa4-4966-add3-234d50145c5e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:51.176553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3c6cb-d20b-4911-96d1-68d89e73896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:51.177452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3c6cb-d20b-4911-96d1-68d89e73896c None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:51.177730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3c6cb-d20b-4911-96d1-68d89e73896c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:51.177984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3c6cb-d20b-4911-96d1-68d89e73896c None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/f91c2e9ae8844d9181aff785c02cf3be/roles/74cddf0b8dcb4fc3a1fb0247747d00a8` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:51.180284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3c6cb-d20b-4911-96d1-68d89e73896c None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=f91c2e9ae8844d9181aff785c02cf3be, role_id=74cddf0b8dcb4fc3a1fb0247747d00a8)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:51.181732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3c6cb-d20b-4911-96d1-68d89e73896c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:51.196268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 521/1077] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:08:51 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/f91c2e9ae8844d9181aff785c02cf3be/roles/74cddf0b8dcb4fc3a1fb0247747d00a8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:08:51.307726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364b0b1-0c22-48db-b351-f76117f66872 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:51.308318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364b0b1-0c22-48db-b351-f76117f66872 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:51.308318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364b0b1-0c22-48db-b351-f76117f66872 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:51.309659 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 557/1078] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:51.315692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ec48-989e-4e12-a1be-3263c9d6286f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:51.315934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ec48-989e-4e12-a1be-3263c9d6286f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:51.316241 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ec48-989e-4e12-a1be-3263c9d6286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:51.333875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3f08ec48-989e-4e12-a1be-3263c9d6286f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:51.335149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3f08ec48-989e-4e12-a1be-3263c9d6286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:51.398233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:51.409076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 522/1079] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:51.432520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364b0b1-0c22-48db-b351-f76117f66872 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:51.541076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364b0b1-0c22-48db-b351-f76117f66872 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:51.577015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce75da6-5c25-4bc1-b206-c81be68d0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:51.577816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75da6-5c25-4bc1-b206-c81be68d0295 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:51.578099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75da6-5c25-4bc1-b206-c81be68d0295 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:51.578376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75da6-5c25-4bc1-b206-c81be68d0295 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:51.589604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce75da6-5c25-4bc1-b206-c81be68d0295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-fce75da6-5c25-4bc1-b206-c81be68d0295 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:51.597306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:51.598308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:51.599317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 558/1080] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:51.605528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08ec48-989e-4e12-a1be-3263c9d6286f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:51.710846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08ec48-989e-4e12-a1be-3263c9d6286f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:51.746347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7078287-e6a3-419a-9f9b-542985936138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:51.747044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7078287-e6a3-419a-9f9b-542985936138 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:51.747318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7078287-e6a3-419a-9f9b-542985936138 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:51.747592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7078287-e6a3-419a-9f9b-542985936138 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:51.748339 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7078287-e6a3-419a-9f9b-542985936138 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:51.748650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7078287-e6a3-419a-9f9b-542985936138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:51.750051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7078287-e6a3-419a-9f9b-542985936138 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:51.758763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 523/1081] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:08:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:51.764768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce75da6-5c25-4bc1-b206-c81be68d0295 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:51.792217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:51.874032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce75da6-5c25-4bc1-b206-c81be68d0295 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:51.910196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478d530-0718-47d3-b633-520197e81235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:51.911131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478d530-0718-47d3-b633-520197e81235 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:51.911407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478d530-0718-47d3-b633-520197e81235 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:51.911678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478d530-0718-47d3-b633-520197e81235 None admin] PATH_INFO: `/v3/users/d7dd540856bf4e06aafe215440787072` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:51.913131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478d530-0718-47d3-b633-520197e81235 None admin] RBAC: Authorizing `identity:get_user(user_id=d7dd540856bf4e06aafe215440787072)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:51.914605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478d530-0718-47d3-b633-520197e81235 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:51.916323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 559/1082] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:08:51 2022] GET /identity/v3/users/d7dd540856bf4e06aafe215440787072 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:51.922227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7078287-e6a3-419a-9f9b-542985936138 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:51.978217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:52.023304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7078287-e6a3-419a-9f9b-542985936138 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:52.058244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a17556-ca07-40b3-ac8e-4440af1e502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:52.059142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a17556-ca07-40b3-ac8e-4440af1e502c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:52.059423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a17556-ca07-40b3-ac8e-4440af1e502c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:52.059704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a17556-ca07-40b3-ac8e-4440af1e502c None admin] PATH_INFO: `/v3/projects/433d35727dc04fbe9f0416d731cec17e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:52.060929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a17556-ca07-40b3-ac8e-4440af1e502c None admin] RBAC: Authorizing `identity:get_project(project_id=433d35727dc04fbe9f0416d731cec17e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:52.062391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a17556-ca07-40b3-ac8e-4440af1e502c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:52.064180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 524/1083] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:08:51 2022] GET /identity/v3/projects/433d35727dc04fbe9f0416d731cec17e => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:52.070354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478d530-0718-47d3-b633-520197e81235 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:52.168005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:52.178171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478d530-0718-47d3-b633-520197e81235 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:52.212633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d694d4a-1d1b-4028-8596-fa926d33d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:52.213530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d694d4a-1d1b-4028-8596-fa926d33d11f None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:52.213813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d694d4a-1d1b-4028-8596-fa926d33d11f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:52.214090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d694d4a-1d1b-4028-8596-fa926d33d11f None admin] PATH_INFO: `/v3/projects/433d35727dc04fbe9f0416d731cec17e/users/d7dd540856bf4e06aafe215440787072/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:52.216092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d694d4a-1d1b-4028-8596-fa926d33d11f None admin] RBAC: Authorizing `identity:create_grant(project_id=433d35727dc04fbe9f0416d731cec17e, user_id=d7dd540856bf4e06aafe215440787072, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:52.217551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d694d4a-1d1b-4028-8596-fa926d33d11f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:52.231770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 560/1084] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:08:52 2022] PUT /identity/v3/projects/433d35727dc04fbe9f0416d731cec17e/users/d7dd540856bf4e06aafe215440787072/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:08:53.188607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056d11-6fa5-4593-8f24-0dd5b8206799 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:53.189183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056d11-6fa5-4593-8f24-0dd5b8206799 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:53.189183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056d11-6fa5-4593-8f24-0dd5b8206799 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:53.190621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 525/1085] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:53.196348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8493a66-fe12-44e1-aee3-366db2a084bd None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:53.196801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8493a66-fe12-44e1-aee3-366db2a084bd None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:53.196928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8493a66-fe12-44e1-aee3-366db2a084bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:53.215813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-f8493a66-fe12-44e1-aee3-366db2a084bd None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:53.217005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f8493a66-fe12-44e1-aee3-366db2a084bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:53.289988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 561/1086] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:53.313622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056d11-6fa5-4593-8f24-0dd5b8206799 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:53.418929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056d11-6fa5-4593-8f24-0dd5b8206799 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:53.442385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:53.454106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddda77-6cb5-4ca7-b7f1-b33d05df9d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:53.454998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddda77-6cb5-4ca7-b7f1-b33d05df9d12 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:53.455278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddda77-6cb5-4ca7-b7f1-b33d05df9d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:53.455547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddda77-6cb5-4ca7-b7f1-b33d05df9d12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:53.466323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddda77-6cb5-4ca7-b7f1-b33d05df9d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-57ddda77-6cb5-4ca7-b7f1-b33d05df9d12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:53.474307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:53.475330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:53.476194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 526/1087] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 10:08:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:53.481889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8493a66-fe12-44e1-aee3-366db2a084bd None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:53.570670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:53.591106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8493a66-fe12-44e1-aee3-366db2a084bd None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:53.625754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f2042-99be-4b76-b9c5-d37c2c03fe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:53.626459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2042-99be-4b76-b9c5-d37c2c03fe70 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:53.626762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2042-99be-4b76-b9c5-d37c2c03fe70 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:53.627035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2042-99be-4b76-b9c5-d37c2c03fe70 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:53.627780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f2042-99be-4b76-b9c5-d37c2c03fe70 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:53.628082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f2042-99be-4b76-b9c5-d37c2c03fe70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:53.629465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f2042-99be-4b76-b9c5-d37c2c03fe70 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:53.640038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 562/1088] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 10:08:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:53.643490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddda77-6cb5-4ca7-b7f1-b33d05df9d12 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:53.745816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddda77-6cb5-4ca7-b7f1-b33d05df9d12 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:53.781323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c273c2-8ca8-4eb3-abfe-9a15f1fa4583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:53.782131 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c273c2-8ca8-4eb3-abfe-9a15f1fa4583 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:53.782408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c273c2-8ca8-4eb3-abfe-9a15f1fa4583 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:53.782707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c273c2-8ca8-4eb3-abfe-9a15f1fa4583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:53.793617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c273c2-8ca8-4eb3-abfe-9a15f1fa4583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:53.795112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c273c2-8ca8-4eb3-abfe-9a15f1fa4583 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d7c273c2-8ca8-4eb3-abfe-9a15f1fa4583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:53.813261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:53.814249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:53.815230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:53.815230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:53.815230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:53.815230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:53.815230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 527/1089] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:53.820559 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f2042-99be-4b76-b9c5-d37c2c03fe70 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:53.931517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f2042-99be-4b76-b9c5-d37c2c03fe70 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:53.967022 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6496-d602-471f-952b-68c3310b6efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:53.967685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6496-d602-471f-952b-68c3310b6efb None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:53.967970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6496-d602-471f-952b-68c3310b6efb None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:53.968243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6496-d602-471f-952b-68c3310b6efb None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:53.968964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b6496-d602-471f-952b-68c3310b6efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:53.969271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b6496-d602-471f-952b-68c3310b6efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:53.970675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b6496-d602-471f-952b-68c3310b6efb None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:53.982970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 563/1090] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:53.988501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c273c2-8ca8-4eb3-abfe-9a15f1fa4583 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:54.026100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:54.090558 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c273c2-8ca8-4eb3-abfe-9a15f1fa4583 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:54.126377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973c9db-ea87-4bf3-98b0-a93cb57a45f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:54.127199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c9db-ea87-4bf3-98b0-a93cb57a45f8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.127479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c9db-ea87-4bf3-98b0-a93cb57a45f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.127744 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c9db-ea87-4bf3-98b0-a93cb57a45f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.136024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973c9db-ea87-4bf3-98b0-a93cb57a45f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:54.137473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973c9db-ea87-4bf3-98b0-a93cb57a45f8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0973c9db-ea87-4bf3-98b0-a93cb57a45f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:08:54.152115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:54.153264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:54.154226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:54.154226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:54.154226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:08:54.154226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:08:54.154226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:08:54.154226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:08:54.154226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:08:54.154226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:08:54.154226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:08:54.154226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:54.154806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 528/1091] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 10:08:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:54.160332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6496-d602-471f-952b-68c3310b6efb None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:54.165641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:54.249311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9262-499e-425e-a4be-08e305d42362 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.249869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9262-499e-425e-a4be-08e305d42362 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.249869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9262-499e-425e-a4be-08e305d42362 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.251278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 529/1092] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:54.256696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08a407-0cfa-46ef-a1e8-ed910b6a88dc None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.256987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08a407-0cfa-46ef-a1e8-ed910b6a88dc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.257262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08a407-0cfa-46ef-a1e8-ed910b6a88dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.275846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5c08a407-0cfa-46ef-a1e8-ed910b6a88dc None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:54.276061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6496-d602-471f-952b-68c3310b6efb None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:54.277105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5c08a407-0cfa-46ef-a1e8-ed910b6a88dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:54.312471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccaf1b-aad2-4823-92f8-d8e750bffc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:54.313111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccaf1b-aad2-4823-92f8-d8e750bffc13 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.313390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccaf1b-aad2-4823-92f8-d8e750bffc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.313662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccaf1b-aad2-4823-92f8-d8e750bffc13 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.314519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccaf1b-aad2-4823-92f8-d8e750bffc13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:54.314832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccaf1b-aad2-4823-92f8-d8e750bffc13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:54.316270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccaf1b-aad2-4823-92f8-d8e750bffc13 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:54.334232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 564/1093] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 10:08:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:54.340093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccaf1b-aad2-4823-92f8-d8e750bffc13 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:54.347870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 530/1094] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:54.371523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08a407-0cfa-46ef-a1e8-ed910b6a88dc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:54.399630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:54.402650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:54.444698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccaf1b-aad2-4823-92f8-d8e750bffc13 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:54.475477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08a407-0cfa-46ef-a1e8-ed910b6a88dc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:54.479124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec559d0-3b32-4e98-80d5-7b0b0f91418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:54.479844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec559d0-3b32-4e98-80d5-7b0b0f91418c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.480129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec559d0-3b32-4e98-80d5-7b0b0f91418c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.480414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec559d0-3b32-4e98-80d5-7b0b0f91418c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.509766 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a29a9-1e60-4043-a53e-e6a62da99f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:54.510598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a29a9-1e60-4043-a53e-e6a62da99f94 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.510876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a29a9-1e60-4043-a53e-e6a62da99f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.511246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a29a9-1e60-4043-a53e-e6a62da99f94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.521616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a29a9-1e60-4043-a53e-e6a62da99f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-fd3a29a9-1e60-4043-a53e-e6a62da99f94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:08:54.529529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:54.530586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:08:54.535601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 531/1095] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:08:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:54.536987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a29a9-1e60-4043-a53e-e6a62da99f94 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:54.550324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec559d0-3b32-4e98-80d5-7b0b0f91418c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:54.551872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec559d0-3b32-4e98-80d5-7b0b0f91418c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:54.613871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:54.625370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:54.641370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a29a9-1e60-4043-a53e-e6a62da99f94 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:54.656363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 565/1096] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:54.662438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec559d0-3b32-4e98-80d5-7b0b0f91418c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:54.675508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2beb77-8854-484e-9f8b-cdee5b25ef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:54.676192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2beb77-8854-484e-9f8b-cdee5b25ef34 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.676477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2beb77-8854-484e-9f8b-cdee5b25ef34 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.676757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2beb77-8854-484e-9f8b-cdee5b25ef34 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.677516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2beb77-8854-484e-9f8b-cdee5b25ef34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:54.677823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2beb77-8854-484e-9f8b-cdee5b25ef34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:54.679248 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2beb77-8854-484e-9f8b-cdee5b25ef34 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:54.687620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 532/1097] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:54.693504 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2beb77-8854-484e-9f8b-cdee5b25ef34 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:54.760025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec559d0-3b32-4e98-80d5-7b0b0f91418c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:54.794657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021ad61-b8e4-43b5-bfbe-3fc18730d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:54.795367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021ad61-b8e4-43b5-bfbe-3fc18730d313 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.795742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021ad61-b8e4-43b5-bfbe-3fc18730d313 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.796016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021ad61-b8e4-43b5-bfbe-3fc18730d313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.801501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2beb77-8854-484e-9f8b-cdee5b25ef34 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:54.806352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021ad61-b8e4-43b5-bfbe-3fc18730d313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:54.807975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021ad61-b8e4-43b5-bfbe-3fc18730d313 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-8021ad61-b8e4-43b5-bfbe-3fc18730d313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:08:54.825345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:54.826554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:54.827972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:08:54.827972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:08:54.827972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:08:54.827972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:54.827972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 566/1098] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:08:54.832173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021ad61-b8e4-43b5-bfbe-3fc18730d313 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:54.840327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72dd7-91af-4e90-9221-e7e17de245cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:54.841221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72dd7-91af-4e90-9221-e7e17de245cd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.841504 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72dd7-91af-4e90-9221-e7e17de245cd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.841782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72dd7-91af-4e90-9221-e7e17de245cd None admin] PATH_INFO: `/v3/users/d7dd540856bf4e06aafe215440787072` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.843030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72dd7-91af-4e90-9221-e7e17de245cd None admin] RBAC: Authorizing `identity:get_user(user_id=d7dd540856bf4e06aafe215440787072)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:54.844522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72dd7-91af-4e90-9221-e7e17de245cd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:54.849719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 533/1099] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:08:54 2022] GET /identity/v3/users/d7dd540856bf4e06aafe215440787072 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:54.852073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72dd7-91af-4e90-9221-e7e17de245cd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:54.852359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:54.871988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:54.939816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021ad61-b8e4-43b5-bfbe-3fc18730d313 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:54.955207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72dd7-91af-4e90-9221-e7e17de245cd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:54.973590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad138e38-d1db-4ee0-9d2c-bcb236f762cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:54.974251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad138e38-d1db-4ee0-9d2c-bcb236f762cc None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.974556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad138e38-d1db-4ee0-9d2c-bcb236f762cc None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.974826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad138e38-d1db-4ee0-9d2c-bcb236f762cc None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.975543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad138e38-d1db-4ee0-9d2c-bcb236f762cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:54.975847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad138e38-d1db-4ee0-9d2c-bcb236f762cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:54.977213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad138e38-d1db-4ee0-9d2c-bcb236f762cc None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:54.988067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19b95e-555f-450b-a4e7-5bf4b2a7ea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:54.988745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19b95e-555f-450b-a4e7-5bf4b2a7ea7f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.988867 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 567/1100] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:54.989025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19b95e-555f-450b-a4e7-5bf4b2a7ea7f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.989288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19b95e-555f-450b-a4e7-5bf4b2a7ea7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.994768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad138e38-d1db-4ee0-9d2c-bcb236f762cc None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:55.059804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19b95e-555f-450b-a4e7-5bf4b2a7ea7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:55.061196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19b95e-555f-450b-a4e7-5bf4b2a7ea7f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:55.068731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:55.079373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:55.095314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad138e38-d1db-4ee0-9d2c-bcb236f762cc None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:55.128843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f76e5-fb66-450d-abc3-17acceb77118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:55.129642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f76e5-fb66-450d-abc3-17acceb77118 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:55.129922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f76e5-fb66-450d-abc3-17acceb77118 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:55.130191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f76e5-fb66-450d-abc3-17acceb77118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:55.137152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f76e5-fb66-450d-abc3-17acceb77118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:55.138635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f76e5-fb66-450d-abc3-17acceb77118 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-bd3f76e5-fb66-450d-abc3-17acceb77118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:08:55.152676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:08:55.153637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:08:55.154734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:08:55.154734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:08:55.154734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:08:55.154734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:08:55.154734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:08:55.154734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:08:55.154734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:08:55.154734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:08:55.154734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 568/1101] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:08:55.160215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f76e5-fb66-450d-abc3-17acceb77118 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:55.165002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 534/1102] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:08:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:55.171287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19b95e-555f-450b-a4e7-5bf4b2a7ea7f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:55.264475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f76e5-fb66-450d-abc3-17acceb77118 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:55.274900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19b95e-555f-450b-a4e7-5bf4b2a7ea7f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:55.293328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:55.303979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d79aa9-84c5-46b2-ba64-77ea2d445feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:55.304724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79aa9-84c5-46b2-ba64-77ea2d445feb None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:55.304909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79aa9-84c5-46b2-ba64-77ea2d445feb None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:55.305183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79aa9-84c5-46b2-ba64-77ea2d445feb None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:55.306008 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d79aa9-84c5-46b2-ba64-77ea2d445feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:55.306345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d79aa9-84c5-46b2-ba64-77ea2d445feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:55.307864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d79aa9-84c5-46b2-ba64-77ea2d445feb None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:55.309492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:55.313258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa053-15a7-42fa-ae5a-c4bb810b20bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:55.314066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa053-15a7-42fa-ae5a-c4bb810b20bb None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:55.314345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa053-15a7-42fa-ae5a-c4bb810b20bb None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:55.314649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa053-15a7-42fa-ae5a-c4bb810b20bb None admin] PATH_INFO: `/v3/projects/433d35727dc04fbe9f0416d731cec17e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:55.315833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa053-15a7-42fa-ae5a-c4bb810b20bb None admin] RBAC: Authorizing `identity:get_project(project_id=433d35727dc04fbe9f0416d731cec17e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:55.317258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa053-15a7-42fa-ae5a-c4bb810b20bb None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:55.319341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 535/1103] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:08:55 2022] GET /identity/v3/projects/433d35727dc04fbe9f0416d731cec17e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:55.320877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 569/1104] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:55.325413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa053-15a7-42fa-ae5a-c4bb810b20bb None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:55.326815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d79aa9-84c5-46b2-ba64-77ea2d445feb None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:55.424882 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa053-15a7-42fa-ae5a-c4bb810b20bb None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:55.425140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d79aa9-84c5-46b2-ba64-77ea2d445feb None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:55.458905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd67175-ecb7-4da5-b307-94140c65dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:55.459123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe81d-1c87-4569-9bfb-548746bcffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:55.459597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd67175-ecb7-4da5-b307-94140c65dd99 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:55.459787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe81d-1c87-4569-9bfb-548746bcffe8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:55.459910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd67175-ecb7-4da5-b307-94140c65dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:55.460074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe81d-1c87-4569-9bfb-548746bcffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:55.460170 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd67175-ecb7-4da5-b307-94140c65dd99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:55.460355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe81d-1c87-4569-9bfb-548746bcffe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:55.460916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd67175-ecb7-4da5-b307-94140c65dd99 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=433d35727dc04fbe9f0416d731cec17e, user.id=d7dd540856bf4e06aafe215440787072) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:55.461195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fe81d-1c87-4569-9bfb-548746bcffe8 None admin] RBAC: Adding query filter params (role.id=74cddf0b8dcb4fc3a1fb0247747d00a8, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=f91c2e9ae8844d9181aff785c02cf3be) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:08:55.461340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd67175-ecb7-4da5-b307-94140c65dd99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:55.461529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fe81d-1c87-4569-9bfb-548746bcffe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:55.462677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd67175-ecb7-4da5-b307-94140c65dd99 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:55.462978 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fe81d-1c87-4569-9bfb-548746bcffe8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:55.474592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 536/1105] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:55 2022] GET /identity/v3/role_assignments?user.id=d7dd540856bf4e06aafe215440787072&scope.project.id=433d35727dc04fbe9f0416d731cec17e&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:55.474864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 570/1106] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:08:55 2022] GET /identity/v3/role_assignments?user.id=f91c2e9ae8844d9181aff785c02cf3be&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=74cddf0b8dcb4fc3a1fb0247747d00a8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:08:57.551419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedc84c-d965-4a4a-a77c-f4ee712833c6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:57.551979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedc84c-d965-4a4a-a77c-f4ee712833c6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:57.551979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedc84c-d965-4a4a-a77c-f4ee712833c6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:57.553347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 537/1107] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:57.559338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05e2e-beec-4927-b693-7e4640458914 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:57.559996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05e2e-beec-4927-b693-7e4640458914 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:57.559996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05e2e-beec-4927-b693-7e4640458914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:57.581415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-7fc05e2e-beec-4927-b693-7e4640458914 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:57.582693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-7fc05e2e-beec-4927-b693-7e4640458914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:57.642130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:57.657832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 571/1108] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:08:57.683339 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedc84c-d965-4a4a-a77c-f4ee712833c6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:57.735947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:57.791112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedc84c-d965-4a4a-a77c-f4ee712833c6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:57.828326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72651765-450f-4360-ada9-786efaa38568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:57.828979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72651765-450f-4360-ada9-786efaa38568 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:57.829262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72651765-450f-4360-ada9-786efaa38568 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:57.829530 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72651765-450f-4360-ada9-786efaa38568 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:57.830779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72651765-450f-4360-ada9-786efaa38568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:57.832230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72651765-450f-4360-ada9-786efaa38568 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:57.833869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 538/1109] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:08:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:08:57.840094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05e2e-beec-4927-b693-7e4640458914 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:57.949433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05e2e-beec-4927-b693-7e4640458914 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:57.984512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b401de0-f469-459e-9391-f9f9f3b54c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:57.985183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b401de0-f469-459e-9391-f9f9f3b54c88 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:57.985428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b401de0-f469-459e-9391-f9f9f3b54c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:57.985698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b401de0-f469-459e-9391-f9f9f3b54c88 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:57.986442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b401de0-f469-459e-9391-f9f9f3b54c88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:57.987914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b401de0-f469-459e-9391-f9f9f3b54c88 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:58.010454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 572/1110] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:08:57 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:09:00.068090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147ffaa-9151-4518-82a8-66caa37764fc None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.068644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147ffaa-9151-4518-82a8-66caa37764fc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.068644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147ffaa-9151-4518-82a8-66caa37764fc None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.069945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 539/1111] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:00.075596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2232c-498c-4432-be76-841bc174c631 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.076016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2232c-498c-4432-be76-841bc174c631 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.076163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2232c-498c-4432-be76-841bc174c631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.094310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-fee2232c-498c-4432-be76-841bc174c631 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:00.095547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-fee2232c-498c-4432-be76-841bc174c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:00.138371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:00.168591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 573/1112] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:00.192778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147ffaa-9151-4518-82a8-66caa37764fc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:00.303704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147ffaa-9151-4518-82a8-66caa37764fc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:00.322783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:00.343538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f44153-2ea1-4c3f-9025-f2c65d713823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:00.344401 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f44153-2ea1-4c3f-9025-f2c65d713823 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.344683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f44153-2ea1-4c3f-9025-f2c65d713823 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.344958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f44153-2ea1-4c3f-9025-f2c65d713823 None admin] PATH_INFO: `/v3/roles/26c081183cd3490c977d961b36b9cee4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.346520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f44153-2ea1-4c3f-9025-f2c65d713823 None admin] RBAC: Authorizing `identity:get_role(role_id=26c081183cd3490c977d961b36b9cee4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:00.347907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f44153-2ea1-4c3f-9025-f2c65d713823 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:00.349309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 540/1113] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:00 2022] GET /identity/v3/roles/26c081183cd3490c977d961b36b9cee4 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:00.355617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2232c-498c-4432-be76-841bc174c631 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:00.457928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2232c-498c-4432-be76-841bc174c631 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:00.493947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf7e1f-7727-4f41-bc2b-b40acce0f06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:00.494857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf7e1f-7727-4f41-bc2b-b40acce0f06c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.495160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf7e1f-7727-4f41-bc2b-b40acce0f06c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.495434 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf7e1f-7727-4f41-bc2b-b40acce0f06c None admin] PATH_INFO: `/v3/users/6b8a1ac9d453456c9463c58ec6a4bfc1` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.508758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf7e1f-7727-4f41-bc2b-b40acce0f06c None admin] RBAC: Authorizing `identity:get_user(user_id=6b8a1ac9d453456c9463c58ec6a4bfc1)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:00.510196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf7e1f-7727-4f41-bc2b-b40acce0f06c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:00.511948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 574/1114] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:00 2022] GET /identity/v3/users/6b8a1ac9d453456c9463c58ec6a4bfc1 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:09:00.517944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f44153-2ea1-4c3f-9025-f2c65d713823 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:00.626654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f44153-2ea1-4c3f-9025-f2c65d713823 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:00.664487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb38c0-1750-4205-98bd-cc1c523cdc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:00.665244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb38c0-1750-4205-98bd-cc1c523cdc07 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.665430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb38c0-1750-4205-98bd-cc1c523cdc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.665703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb38c0-1750-4205-98bd-cc1c523cdc07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.724070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:00.741843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb38c0-1750-4205-98bd-cc1c523cdc07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:00.743329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb38c0-1750-4205-98bd-cc1c523cdc07 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:00.845521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 541/1115] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:09:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:00.851988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf7e1f-7727-4f41-bc2b-b40acce0f06c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:00.886664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:00.959704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf7e1f-7727-4f41-bc2b-b40acce0f06c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:00.996013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3b828-e7ba-40f5-83b4-8a8cdbce391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:00.996871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b828-e7ba-40f5-83b4-8a8cdbce391b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.997151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b828-e7ba-40f5-83b4-8a8cdbce391b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.997420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b828-e7ba-40f5-83b4-8a8cdbce391b None admin] PATH_INFO: `/v3/projects/433d35727dc04fbe9f0416d731cec17e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.998652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3b828-e7ba-40f5-83b4-8a8cdbce391b None admin] RBAC: Authorizing `identity:get_project(project_id=433d35727dc04fbe9f0416d731cec17e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:01.000091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3b828-e7ba-40f5-83b4-8a8cdbce391b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:01.001827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 575/1116] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:09:00 2022] GET /identity/v3/projects/433d35727dc04fbe9f0416d731cec17e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:01.008152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb38c0-1750-4205-98bd-cc1c523cdc07 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:01.094138 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:01.111120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb38c0-1750-4205-98bd-cc1c523cdc07 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:01.146564 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e4af4-e5de-4805-9304-38335c0059ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:01.147130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e4af4-e5de-4805-9304-38335c0059ff None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:01.147404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e4af4-e5de-4805-9304-38335c0059ff None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:01.147677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e4af4-e5de-4805-9304-38335c0059ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:01.148503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e4af4-e5de-4805-9304-38335c0059ff None admin] RBAC: Adding query filter params (role.id=26c081183cd3490c977d961b36b9cee4, scope.project.id=433d35727dc04fbe9f0416d731cec17e, user.id=6b8a1ac9d453456c9463c58ec6a4bfc1) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:01.148812 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e4af4-e5de-4805-9304-38335c0059ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:01.150239 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e4af4-e5de-4805-9304-38335c0059ff None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:01.155979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 542/1117] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:09:01 2022] GET /identity/v3/role_assignments?user.id=6b8a1ac9d453456c9463c58ec6a4bfc1&scope.project.id=433d35727dc04fbe9f0416d731cec17e&role.id=26c081183cd3490c977d961b36b9cee4 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:03.132342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545743-e13c-4df6-9a62-e4190a5ea2a8 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:03.132924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545743-e13c-4df6-9a62-e4190a5ea2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:03.132924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545743-e13c-4df6-9a62-e4190a5ea2a8 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:03.134272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 576/1118] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:03.139706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dc2fe-5f39-4a7a-a938-750513790a3b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:03.140147 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dc2fe-5f39-4a7a-a938-750513790a3b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:03.140249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dc2fe-5f39-4a7a-a938-750513790a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:03.157356 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b42dc2fe-5f39-4a7a-a938-750513790a3b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:03.158908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b42dc2fe-5f39-4a7a-a938-750513790a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:03.227446 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 543/1119] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:03.249974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a545743-e13c-4df6-9a62-e4190a5ea2a8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:03.362578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:03.367702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a545743-e13c-4df6-9a62-e4190a5ea2a8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:03.405007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcffd35-8987-4b75-acfc-d1e61d3fd723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:03.405932 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcffd35-8987-4b75-acfc-d1e61d3fd723 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:03.406309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcffd35-8987-4b75-acfc-d1e61d3fd723 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:03.406727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcffd35-8987-4b75-acfc-d1e61d3fd723 None admin] PATH_INFO: `/v3/roles/26c081183cd3490c977d961b36b9cee4` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:03.408765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcffd35-8987-4b75-acfc-d1e61d3fd723 None admin] RBAC: Authorizing `identity:get_role(role_id=26c081183cd3490c977d961b36b9cee4)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:03.410160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcffd35-8987-4b75-acfc-d1e61d3fd723 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:03.411635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 577/1120] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:03 2022] GET /identity/v3/roles/26c081183cd3490c977d961b36b9cee4 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:03.417852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dc2fe-5f39-4a7a-a938-750513790a3b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:03.497768 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:03.522386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dc2fe-5f39-4a7a-a938-750513790a3b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:03.563472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ef8bb-531a-45d8-abd9-4777291ed246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:03.564342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef8bb-531a-45d8-abd9-4777291ed246 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:03.564621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef8bb-531a-45d8-abd9-4777291ed246 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:03.564919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef8bb-531a-45d8-abd9-4777291ed246 None admin] PATH_INFO: `/v3/users/6b8a1ac9d453456c9463c58ec6a4bfc1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:03.566134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ef8bb-531a-45d8-abd9-4777291ed246 None admin] RBAC: Authorizing `identity:get_user(user_id=6b8a1ac9d453456c9463c58ec6a4bfc1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:03.567627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ef8bb-531a-45d8-abd9-4777291ed246 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:03.571611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 544/1121] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:03 2022] GET /identity/v3/users/6b8a1ac9d453456c9463c58ec6a4bfc1 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:03.579405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcffd35-8987-4b75-acfc-d1e61d3fd723 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:03.695488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcffd35-8987-4b75-acfc-d1e61d3fd723 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:03.733702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f5561-2b86-4a73-a83a-90f77039372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:03.735036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f5561-2b86-4a73-a83a-90f77039372f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:03.735415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f5561-2b86-4a73-a83a-90f77039372f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:03.735804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f5561-2b86-4a73-a83a-90f77039372f None admin] PATH_INFO: `/v3/projects/433d35727dc04fbe9f0416d731cec17e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:03.737782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f5561-2b86-4a73-a83a-90f77039372f None admin] RBAC: Authorizing `identity:get_project(project_id=433d35727dc04fbe9f0416d731cec17e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:03.740116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f5561-2b86-4a73-a83a-90f77039372f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:03.742814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 578/1122] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:09:03 2022] GET /identity/v3/projects/433d35727dc04fbe9f0416d731cec17e => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:03.749173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ef8bb-531a-45d8-abd9-4777291ed246 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:03.852426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ef8bb-531a-45d8-abd9-4777291ed246 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:03.887945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb9228-5b2a-4325-a9e7-6e178715f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:03.888837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb9228-5b2a-4325-a9e7-6e178715f213 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:03.889125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb9228-5b2a-4325-a9e7-6e178715f213 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:03.889395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb9228-5b2a-4325-a9e7-6e178715f213 None admin] PATH_INFO: `/v3/projects/433d35727dc04fbe9f0416d731cec17e/users/6b8a1ac9d453456c9463c58ec6a4bfc1/roles/26c081183cd3490c977d961b36b9cee4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:03.891811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb9228-5b2a-4325-a9e7-6e178715f213 None admin] RBAC: Authorizing `identity:create_grant(project_id=433d35727dc04fbe9f0416d731cec17e, user_id=6b8a1ac9d453456c9463c58ec6a4bfc1, role_id=26c081183cd3490c977d961b36b9cee4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:03.893257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb9228-5b2a-4325-a9e7-6e178715f213 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:03.908316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 545/1123] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:09:03 2022] PUT /identity/v3/projects/433d35727dc04fbe9f0416d731cec17e/users/6b8a1ac9d453456c9463c58ec6a4bfc1/roles/26c081183cd3490c977d961b36b9cee4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:09:05.865572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef7594-5c7b-4d23-8473-1e6f5c91e2ea None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:05.866188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef7594-5c7b-4d23-8473-1e6f5c91e2ea None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:05.866188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef7594-5c7b-4d23-8473-1e6f5c91e2ea None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:05.867615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 579/1124] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:05.873075 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a9739-ac68-4142-a65e-007d0090c834 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:05.873510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a9739-ac68-4142-a65e-007d0090c834 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:05.873614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a9739-ac68-4142-a65e-007d0090c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:05.885579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:05.891981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-226a9739-ac68-4142-a65e-007d0090c834 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:05.894010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-226a9739-ac68-4142-a65e-007d0090c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:05.965289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 546/1125] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:05.989148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef7594-5c7b-4d23-8473-1e6f5c91e2ea None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:06.028123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:06.097382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef7594-5c7b-4d23-8473-1e6f5c91e2ea None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:06.132403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e002e7-1372-44ce-ad62-56509c31c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:06.133256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e002e7-1372-44ce-ad62-56509c31c48d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:06.133544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e002e7-1372-44ce-ad62-56509c31c48d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:06.133822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e002e7-1372-44ce-ad62-56509c31c48d None admin] PATH_INFO: `/v3/roles/26c081183cd3490c977d961b36b9cee4` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:06.135370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e002e7-1372-44ce-ad62-56509c31c48d None admin] RBAC: Authorizing `identity:get_role(role_id=26c081183cd3490c977d961b36b9cee4)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:06.136795 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e002e7-1372-44ce-ad62-56509c31c48d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:06.138202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 580/1126] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:05 2022] GET /identity/v3/roles/26c081183cd3490c977d961b36b9cee4 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:06.144303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a9739-ac68-4142-a65e-007d0090c834 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:06.250566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a9739-ac68-4142-a65e-007d0090c834 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:06.286129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691dc35-603c-4414-bd66-a6a3a758fd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:06.287021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691dc35-603c-4414-bd66-a6a3a758fd0f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:06.287318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691dc35-603c-4414-bd66-a6a3a758fd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:06.287572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691dc35-603c-4414-bd66-a6a3a758fd0f None admin] PATH_INFO: `/v3/users/6b8a1ac9d453456c9463c58ec6a4bfc1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:06.288769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691dc35-603c-4414-bd66-a6a3a758fd0f None admin] RBAC: Authorizing `identity:get_user(user_id=6b8a1ac9d453456c9463c58ec6a4bfc1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:06.290192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691dc35-603c-4414-bd66-a6a3a758fd0f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:06.291885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 547/1127] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:06 2022] GET /identity/v3/users/6b8a1ac9d453456c9463c58ec6a4bfc1 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:06.297946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e002e7-1372-44ce-ad62-56509c31c48d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:06.400638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e002e7-1372-44ce-ad62-56509c31c48d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:06.403058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:06.441141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb487382-e41c-49e1-8e21-eb7a75d3a366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:06.441803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487382-e41c-49e1-8e21-eb7a75d3a366 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:06.442104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487382-e41c-49e1-8e21-eb7a75d3a366 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:06.442366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487382-e41c-49e1-8e21-eb7a75d3a366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:06.514776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb487382-e41c-49e1-8e21-eb7a75d3a366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:06.516247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb487382-e41c-49e1-8e21-eb7a75d3a366 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:06.618266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 581/1128] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:09:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:06.624484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691dc35-603c-4414-bd66-a6a3a758fd0f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:06.628517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:06.727408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691dc35-603c-4414-bd66-a6a3a758fd0f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:06.764425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e6983-93ab-4d46-b696-5d49b3918078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:06.765292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e6983-93ab-4d46-b696-5d49b3918078 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:06.765578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e6983-93ab-4d46-b696-5d49b3918078 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:06.765847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e6983-93ab-4d46-b696-5d49b3918078 None admin] PATH_INFO: `/v3/projects/433d35727dc04fbe9f0416d731cec17e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:06.767111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e6983-93ab-4d46-b696-5d49b3918078 None admin] RBAC: Authorizing `identity:get_project(project_id=433d35727dc04fbe9f0416d731cec17e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:06.768546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e6983-93ab-4d46-b696-5d49b3918078 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:06.770261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 548/1129] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:09:06 2022] GET /identity/v3/projects/433d35727dc04fbe9f0416d731cec17e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:06.776641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb487382-e41c-49e1-8e21-eb7a75d3a366 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:06.779866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:06.878328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb487382-e41c-49e1-8e21-eb7a75d3a366 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:06.913488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d38481-e7f3-4dd1-9071-19d5107b82c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:06.914135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d38481-e7f3-4dd1-9071-19d5107b82c0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:06.914420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d38481-e7f3-4dd1-9071-19d5107b82c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:06.914731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d38481-e7f3-4dd1-9071-19d5107b82c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:06.915566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d38481-e7f3-4dd1-9071-19d5107b82c0 None admin] RBAC: Adding query filter params (role.id=26c081183cd3490c977d961b36b9cee4, scope.project.id=433d35727dc04fbe9f0416d731cec17e, user.id=6b8a1ac9d453456c9463c58ec6a4bfc1) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:06.915880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d38481-e7f3-4dd1-9071-19d5107b82c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:06.917364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d38481-e7f3-4dd1-9071-19d5107b82c0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:06.923511 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 582/1130] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:09:06 2022] GET /identity/v3/role_assignments?user.id=6b8a1ac9d453456c9463c58ec6a4bfc1&scope.project.id=433d35727dc04fbe9f0416d731cec17e&role.id=26c081183cd3490c977d961b36b9cee4 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:08.945791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f090-c769-4cf5-8637-8402c9b05001 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:08.946342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f090-c769-4cf5-8637-8402c9b05001 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:08.946342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f090-c769-4cf5-8637-8402c9b05001 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:08.947678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 549/1131] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:08.953918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7771a4e-576a-4822-aa91-14e3a0131fb1 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:08.954408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7771a4e-576a-4822-aa91-14e3a0131fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:08.954534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7771a4e-576a-4822-aa91-14e3a0131fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:08.972633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c7771a4e-576a-4822-aa91-14e3a0131fb1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:08.973839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c7771a4e-576a-4822-aa91-14e3a0131fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:09.039516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:09.045832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 583/1132] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:09.069867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f090-c769-4cf5-8637-8402c9b05001 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:09.143663 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:09.176041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f090-c769-4cf5-8637-8402c9b05001 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:09.211648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334aa7b-df25-4d59-8f2f-576f520a52de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:09.212349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334aa7b-df25-4d59-8f2f-576f520a52de None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:09.212630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334aa7b-df25-4d59-8f2f-576f520a52de None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:09.212904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334aa7b-df25-4d59-8f2f-576f520a52de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:09.214164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334aa7b-df25-4d59-8f2f-576f520a52de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:09.215633 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334aa7b-df25-4d59-8f2f-576f520a52de None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:09.217264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 550/1133] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:09:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:09.223454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7771a4e-576a-4822-aa91-14e3a0131fb1 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:09.327398 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7771a4e-576a-4822-aa91-14e3a0131fb1 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:09.364609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe428ce0-3f73-40af-8b7b-c8e09de3aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:09.365342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428ce0-3f73-40af-8b7b-c8e09de3aea3 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:09.365624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428ce0-3f73-40af-8b7b-c8e09de3aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:09.365897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428ce0-3f73-40af-8b7b-c8e09de3aea3 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:09.366652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe428ce0-3f73-40af-8b7b-c8e09de3aea3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:09.368136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe428ce0-3f73-40af-8b7b-c8e09de3aea3 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:09.398489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 584/1134] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:09:09 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:09:11.434684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0371-2584-4d21-9184-3ef0fb04a871 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:11.435241 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0371-2584-4d21-9184-3ef0fb04a871 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:11.435241 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0371-2584-4d21-9184-3ef0fb04a871 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:11.436626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 551/1135] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:11.442047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eded31-1ea0-4710-a34b-d503af2c0082 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:11.442521 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eded31-1ea0-4710-a34b-d503af2c0082 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:11.442634 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eded31-1ea0-4710-a34b-d503af2c0082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:11.461937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-35eded31-1ea0-4710-a34b-d503af2c0082 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:11.463191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-35eded31-1ea0-4710-a34b-d503af2c0082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:11.519102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:11.544628 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 585/1136] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:11.569600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e0371-2584-4d21-9184-3ef0fb04a871 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:11.678618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e0371-2584-4d21-9184-3ef0fb04a871 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:11.712278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4be48-e5bf-49fb-8269-988b595c0db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:11.713004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4be48-e5bf-49fb-8269-988b595c0db2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:11.713283 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4be48-e5bf-49fb-8269-988b595c0db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:11.713555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4be48-e5bf-49fb-8269-988b595c0db2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:11.714743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4be48-e5bf-49fb-8269-988b595c0db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:11.716167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4be48-e5bf-49fb-8269-988b595c0db2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:11.717827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 552/1137] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:09:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:11.723851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eded31-1ea0-4710-a34b-d503af2c0082 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:11.823680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eded31-1ea0-4710-a34b-d503af2c0082 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:11.858488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f2b25-8e3a-45ad-bd33-d73a851a59fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:11.859178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f2b25-8e3a-45ad-bd33-d73a851a59fe None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:11.859457 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f2b25-8e3a-45ad-bd33-d73a851a59fe None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:11.859730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f2b25-8e3a-45ad-bd33-d73a851a59fe None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:11.860433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f2b25-8e3a-45ad-bd33-d73a851a59fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:11.861878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f2b25-8e3a-45ad-bd33-d73a851a59fe None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:11.883248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 586/1138] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:09:11 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:09:13.942193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f1e4-7c40-49f3-8baa-117f4d1fd90f None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:13.942751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f1e4-7c40-49f3-8baa-117f4d1fd90f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:13.942751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f1e4-7c40-49f3-8baa-117f4d1fd90f None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:13.944018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 553/1139] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:13.949710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b97c7-38b9-4ae6-a27e-682980d05989 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:13.950107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b97c7-38b9-4ae6-a27e-682980d05989 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:13.950270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b97c7-38b9-4ae6-a27e-682980d05989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:13.968291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a13b97c7-38b9-4ae6-a27e-682980d05989 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:13.969495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a13b97c7-38b9-4ae6-a27e-682980d05989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:14.005067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:14.047520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 587/1140] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:09:14.071721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946f1e4-7c40-49f3-8baa-117f4d1fd90f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:14.083403 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:14.182482 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946f1e4-7c40-49f3-8baa-117f4d1fd90f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:14.218104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb825277-1be4-4b81-9089-779ad03a58d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:14.218922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825277-1be4-4b81-9089-779ad03a58d9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:14.219209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825277-1be4-4b81-9089-779ad03a58d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:14.219483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825277-1be4-4b81-9089-779ad03a58d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:14.230342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb825277-1be4-4b81-9089-779ad03a58d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-fb825277-1be4-4b81-9089-779ad03a58d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:09:14.237953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:09:14.239139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:09:14.240173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 554/1141] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:09:14.245525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b97c7-38b9-4ae6-a27e-682980d05989 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:14.349763 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b97c7-38b9-4ae6-a27e-682980d05989 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:14.387338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81cbd9-9d37-4715-b796-d8354562f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:14.388007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81cbd9-9d37-4715-b796-d8354562f517 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:14.388291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81cbd9-9d37-4715-b796-d8354562f517 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:14.388566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81cbd9-9d37-4715-b796-d8354562f517 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:14.389316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81cbd9-9d37-4715-b796-d8354562f517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:14.389625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81cbd9-9d37-4715-b796-d8354562f517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:14.391053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81cbd9-9d37-4715-b796-d8354562f517 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:14.399519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 588/1142] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:14.406594 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb825277-1be4-4b81-9089-779ad03a58d9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:14.478491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:14.513216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb825277-1be4-4b81-9089-779ad03a58d9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:14.547729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff9bb2-86c9-4643-b996-20c90f69ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:14.548608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff9bb2-86c9-4643-b996-20c90f69ccfb None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:14.548894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff9bb2-86c9-4643-b996-20c90f69ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:14.549167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff9bb2-86c9-4643-b996-20c90f69ccfb None admin] PATH_INFO: `/v3/users/f01bfa53fa824cdea829ec850889cd06` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:14.563855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff9bb2-86c9-4643-b996-20c90f69ccfb None admin] RBAC: Authorizing `identity:get_user(user_id=f01bfa53fa824cdea829ec850889cd06)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:14.565314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff9bb2-86c9-4643-b996-20c90f69ccfb None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:14.567022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 555/1143] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:14 2022] GET /identity/v3/users/f01bfa53fa824cdea829ec850889cd06 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:14.573451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81cbd9-9d37-4715-b796-d8354562f517 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:14.606811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:14.689623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81cbd9-9d37-4715-b796-d8354562f517 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:14.725502 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88135ab-1b45-4ba6-99bd-d6e34f6654ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:14.726153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88135ab-1b45-4ba6-99bd-d6e34f6654ef None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:14.726433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88135ab-1b45-4ba6-99bd-d6e34f6654ef None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:14.726746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88135ab-1b45-4ba6-99bd-d6e34f6654ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:14.799730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88135ab-1b45-4ba6-99bd-d6e34f6654ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:14.801094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88135ab-1b45-4ba6-99bd-d6e34f6654ef None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:14.828313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:14.901172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 589/1144] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:09:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:14.907395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff9bb2-86c9-4643-b996-20c90f69ccfb None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:15.008101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff9bb2-86c9-4643-b996-20c90f69ccfb None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:15.034310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:15.043060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfb528-d6dc-47f6-9849-e98b68b53384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:15.043911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfb528-d6dc-47f6-9849-e98b68b53384 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:15.044188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfb528-d6dc-47f6-9849-e98b68b53384 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:15.044460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfb528-d6dc-47f6-9849-e98b68b53384 None admin] PATH_INFO: `/v3/projects/20ad831d835947df8cbe1335df124293` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:15.045662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfb528-d6dc-47f6-9849-e98b68b53384 None admin] RBAC: Authorizing `identity:get_project(project_id=20ad831d835947df8cbe1335df124293)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:15.047120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfb528-d6dc-47f6-9849-e98b68b53384 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:15.048808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 556/1145] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:09:14 2022] GET /identity/v3/projects/20ad831d835947df8cbe1335df124293 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:15.055168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88135ab-1b45-4ba6-99bd-d6e34f6654ef None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:15.160870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88135ab-1b45-4ba6-99bd-d6e34f6654ef None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:15.188179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:15.197710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9445c2-4a00-4e6b-9894-78a8ea91e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:15.198544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9445c2-4a00-4e6b-9894-78a8ea91e781 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:15.198820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9445c2-4a00-4e6b-9894-78a8ea91e781 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:15.199089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9445c2-4a00-4e6b-9894-78a8ea91e781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:15.199922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9445c2-4a00-4e6b-9894-78a8ea91e781 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=20ad831d835947df8cbe1335df124293, user.id=f01bfa53fa824cdea829ec850889cd06) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:15.200234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9445c2-4a00-4e6b-9894-78a8ea91e781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:15.201688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9445c2-4a00-4e6b-9894-78a8ea91e781 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:15.207789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 590/1146] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:09:15 2022] GET /identity/v3/role_assignments?user.id=f01bfa53fa824cdea829ec850889cd06&scope.project.id=20ad831d835947df8cbe1335df124293&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:17.193790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801374ff-e429-48cc-ad1e-94a6bc2e9be9 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:17.194348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801374ff-e429-48cc-ad1e-94a6bc2e9be9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:17.194348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801374ff-e429-48cc-ad1e-94a6bc2e9be9 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:17.195875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 557/1147] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:17.201388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3670d3-3076-424e-a5d3-74fa3adb4a10 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:17.201854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3670d3-3076-424e-a5d3-74fa3adb4a10 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:17.201954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3670d3-3076-424e-a5d3-74fa3adb4a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:17.219550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8d3670d3-3076-424e-a5d3-74fa3adb4a10 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:17.220734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8d3670d3-3076-424e-a5d3-74fa3adb4a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:17.293047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 591/1148] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:17.315935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801374ff-e429-48cc-ad1e-94a6bc2e9be9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:17.423406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801374ff-e429-48cc-ad1e-94a6bc2e9be9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:17.458716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22f398-c21f-4517-b8b0-3555bdb3fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:17.459430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22f398-c21f-4517-b8b0-3555bdb3fd59 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:17.459714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22f398-c21f-4517-b8b0-3555bdb3fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:17.459986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22f398-c21f-4517-b8b0-3555bdb3fd59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:17.470726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22f398-c21f-4517-b8b0-3555bdb3fd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-de22f398-c21f-4517-b8b0-3555bdb3fd59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:09:17.478271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:09:17.479443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:09:17.480357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 558/1149] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:09:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:09:17.486157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3670d3-3076-424e-a5d3-74fa3adb4a10 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:17.589218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3670d3-3076-424e-a5d3-74fa3adb4a10 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:17.612121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:17.625223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576bac0-a845-4232-ba76-2db0c6a4bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:17.625870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576bac0-a845-4232-ba76-2db0c6a4bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:17.626174 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576bac0-a845-4232-ba76-2db0c6a4bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:17.626439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576bac0-a845-4232-ba76-2db0c6a4bcf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:17.627225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576bac0-a845-4232-ba76-2db0c6a4bcf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:17.627532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576bac0-a845-4232-ba76-2db0c6a4bcf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:17.628919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576bac0-a845-4232-ba76-2db0c6a4bcf5 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:17.638096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 592/1150] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:17.643875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22f398-c21f-4517-b8b0-3555bdb3fd59 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:17.701171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:17.753826 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22f398-c21f-4517-b8b0-3555bdb3fd59 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:17.789067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6dfac-64f2-4a9f-b990-e01bc8835842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:17.789937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6dfac-64f2-4a9f-b990-e01bc8835842 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:17.790223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6dfac-64f2-4a9f-b990-e01bc8835842 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:17.790492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6dfac-64f2-4a9f-b990-e01bc8835842 None admin] PATH_INFO: `/v3/users/f01bfa53fa824cdea829ec850889cd06` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:17.791867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6dfac-64f2-4a9f-b990-e01bc8835842 None admin] RBAC: Authorizing `identity:get_user(user_id=f01bfa53fa824cdea829ec850889cd06)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:17.793302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6dfac-64f2-4a9f-b990-e01bc8835842 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:17.795001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 559/1151] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:17 2022] GET /identity/v3/users/f01bfa53fa824cdea829ec850889cd06 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:17.801142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576bac0-a845-4232-ba76-2db0c6a4bcf5 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:17.904850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576bac0-a845-4232-ba76-2db0c6a4bcf5 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:17.939862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea51dc-75aa-43b0-9ce9-50e32abe679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:17.940725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea51dc-75aa-43b0-9ce9-50e32abe679c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:17.940963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea51dc-75aa-43b0-9ce9-50e32abe679c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:17.941275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea51dc-75aa-43b0-9ce9-50e32abe679c None admin] PATH_INFO: `/v3/projects/20ad831d835947df8cbe1335df124293` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:17.942534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea51dc-75aa-43b0-9ce9-50e32abe679c None admin] RBAC: Authorizing `identity:get_project(project_id=20ad831d835947df8cbe1335df124293)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:17.943993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea51dc-75aa-43b0-9ce9-50e32abe679c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:17.945810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 593/1152] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:09:17 2022] GET /identity/v3/projects/20ad831d835947df8cbe1335df124293 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:17.952068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6dfac-64f2-4a9f-b990-e01bc8835842 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:18.063317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6dfac-64f2-4a9f-b990-e01bc8835842 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:18.085538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:18.097903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633b5b6-7ef2-4b77-922c-01ae3a7548c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:18.098815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b5b6-7ef2-4b77-922c-01ae3a7548c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:18.099095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b5b6-7ef2-4b77-922c-01ae3a7548c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:18.099376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b5b6-7ef2-4b77-922c-01ae3a7548c6 None admin] PATH_INFO: `/v3/projects/20ad831d835947df8cbe1335df124293/users/f01bfa53fa824cdea829ec850889cd06/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:18.101370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633b5b6-7ef2-4b77-922c-01ae3a7548c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=20ad831d835947df8cbe1335df124293, user_id=f01bfa53fa824cdea829ec850889cd06, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:18.102845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633b5b6-7ef2-4b77-922c-01ae3a7548c6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:18.116095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 560/1153] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:09:17 2022] PUT /identity/v3/projects/20ad831d835947df8cbe1335df124293/users/f01bfa53fa824cdea829ec850889cd06/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:09:20.108233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f743cbb-7bd5-4b07-b0a2-3d1fe4d225e2 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:20.108770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f743cbb-7bd5-4b07-b0a2-3d1fe4d225e2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:20.108770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f743cbb-7bd5-4b07-b0a2-3d1fe4d225e2 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:20.110169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 594/1154] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:20.115641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c93bf-6a93-485e-b5ef-1195cf3606a9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:20.116060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c93bf-6a93-485e-b5ef-1195cf3606a9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:20.116169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c93bf-6a93-485e-b5ef-1195cf3606a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:20.133876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7b9c93bf-6a93-485e-b5ef-1195cf3606a9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:20.135100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7b9c93bf-6a93-485e-b5ef-1195cf3606a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:20.205634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 561/1155] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:20.229466 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f743cbb-7bd5-4b07-b0a2-3d1fe4d225e2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:20.289359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:20.340862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f743cbb-7bd5-4b07-b0a2-3d1fe4d225e2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:20.383169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8042-adcf-42e2-af53-645341f86cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:20.384185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8042-adcf-42e2-af53-645341f86cab None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:20.384589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8042-adcf-42e2-af53-645341f86cab None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:20.384974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8042-adcf-42e2-af53-645341f86cab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:20.396772 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc8042-adcf-42e2-af53-645341f86cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-09cc8042-adcf-42e2-af53-645341f86cab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:09:20.405489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:09:20.406645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:09:20.407569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 595/1156] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:09:20.413343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c93bf-6a93-485e-b5ef-1195cf3606a9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:20.520548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c93bf-6a93-485e-b5ef-1195cf3606a9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:20.535143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:20.557533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8ca77-8d9a-426b-bb23-2769ec7b0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:20.558245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8ca77-8d9a-426b-bb23-2769ec7b0e2b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:20.558535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8ca77-8d9a-426b-bb23-2769ec7b0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:20.558829 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8ca77-8d9a-426b-bb23-2769ec7b0e2b None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:20.559564 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8ca77-8d9a-426b-bb23-2769ec7b0e2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:20.559871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8ca77-8d9a-426b-bb23-2769ec7b0e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:20.561307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8ca77-8d9a-426b-bb23-2769ec7b0e2b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:20.569907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 562/1157] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:20.576179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8042-adcf-42e2-af53-645341f86cab None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:20.681844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8042-adcf-42e2-af53-645341f86cab None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:20.695491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:20.718399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda61f59-751f-4a5a-80c4-f51b2479739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:20.719315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61f59-751f-4a5a-80c4-f51b2479739f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:20.719595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61f59-751f-4a5a-80c4-f51b2479739f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:20.719874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61f59-751f-4a5a-80c4-f51b2479739f None admin] PATH_INFO: `/v3/users/f01bfa53fa824cdea829ec850889cd06` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:20.721125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda61f59-751f-4a5a-80c4-f51b2479739f None admin] RBAC: Authorizing `identity:get_user(user_id=f01bfa53fa824cdea829ec850889cd06)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:20.722599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda61f59-751f-4a5a-80c4-f51b2479739f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:20.724220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 596/1158] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:20 2022] GET /identity/v3/users/f01bfa53fa824cdea829ec850889cd06 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:20.730595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8ca77-8d9a-426b-bb23-2769ec7b0e2b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:20.832575 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8ca77-8d9a-426b-bb23-2769ec7b0e2b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:20.868199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d760647-d9fd-42f3-802d-a205bc65082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:20.868887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d760647-d9fd-42f3-802d-a205bc65082b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:20.869167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d760647-d9fd-42f3-802d-a205bc65082b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:20.869445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d760647-d9fd-42f3-802d-a205bc65082b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:20.922582 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:20.950129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d760647-d9fd-42f3-802d-a205bc65082b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:20.951602 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d760647-d9fd-42f3-802d-a205bc65082b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:21.056077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 563/1159] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:09:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:21.062251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda61f59-751f-4a5a-80c4-f51b2479739f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:21.163145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda61f59-751f-4a5a-80c4-f51b2479739f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:21.201325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c4c32-5648-4203-b77d-74ee4c994633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:21.202088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c4c32-5648-4203-b77d-74ee4c994633 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:21.202367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c4c32-5648-4203-b77d-74ee4c994633 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:21.202668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c4c32-5648-4203-b77d-74ee4c994633 None admin] PATH_INFO: `/v3/projects/20ad831d835947df8cbe1335df124293` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:21.203885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c4c32-5648-4203-b77d-74ee4c994633 None admin] RBAC: Authorizing `identity:get_project(project_id=20ad831d835947df8cbe1335df124293)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:21.205319 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c4c32-5648-4203-b77d-74ee4c994633 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:21.207068 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 597/1160] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:09:21 2022] GET /identity/v3/projects/20ad831d835947df8cbe1335df124293 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:21.213376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d760647-d9fd-42f3-802d-a205bc65082b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:21.291785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:21.318314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d760647-d9fd-42f3-802d-a205bc65082b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:21.353845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa5410-c784-440d-975e-32525aa65caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:21.354613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa5410-c784-440d-975e-32525aa65caf None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:21.354881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa5410-c784-440d-975e-32525aa65caf None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:21.355152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa5410-c784-440d-975e-32525aa65caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:21.355977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa5410-c784-440d-975e-32525aa65caf None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=20ad831d835947df8cbe1335df124293, user.id=f01bfa53fa824cdea829ec850889cd06) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:21.356284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa5410-c784-440d-975e-32525aa65caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:21.357725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa5410-c784-440d-975e-32525aa65caf None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:21.363940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 564/1161] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:09:21 2022] GET /identity/v3/role_assignments?user.id=f01bfa53fa824cdea829ec850889cd06&scope.project.id=20ad831d835947df8cbe1335df124293&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:23.371877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592ccb-cd12-443b-9980-07213ab77d9d None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:23.372477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592ccb-cd12-443b-9980-07213ab77d9d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:23.372477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592ccb-cd12-443b-9980-07213ab77d9d None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:23.373796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 598/1162] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:23.379209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51974645-e799-4e0f-8513-9144217a4d1a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:23.379655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51974645-e799-4e0f-8513-9144217a4d1a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:23.379776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51974645-e799-4e0f-8513-9144217a4d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:23.397716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-51974645-e799-4e0f-8513-9144217a4d1a None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:23.398941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-51974645-e799-4e0f-8513-9144217a4d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:23.469615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 565/1163] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:23.492167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05592ccb-cd12-443b-9980-07213ab77d9d None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:23.545777 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:23.605111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05592ccb-cd12-443b-9980-07213ab77d9d None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:23.642621 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26fc50-0ea8-4617-af67-513bf4797f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:23.643058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26fc50-0ea8-4617-af67-513bf4797f64 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:23.643341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26fc50-0ea8-4617-af67-513bf4797f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:23.643610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26fc50-0ea8-4617-af67-513bf4797f64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:23.717999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26fc50-0ea8-4617-af67-513bf4797f64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:23.719497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26fc50-0ea8-4617-af67-513bf4797f64 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:23.770956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:23.825874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 599/1164] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:09:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:23.832106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51974645-e799-4e0f-8513-9144217a4d1a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:23.901461 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:23.936004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51974645-e799-4e0f-8513-9144217a4d1a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:23.971236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f79dd6-d5fd-4d62-aa4d-602ce6573f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:23.972067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f79dd6-d5fd-4d62-aa4d-602ce6573f1e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:23.972350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f79dd6-d5fd-4d62-aa4d-602ce6573f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:23.972620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f79dd6-d5fd-4d62-aa4d-602ce6573f1e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:23.979529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f79dd6-d5fd-4d62-aa4d-602ce6573f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:23.980965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f79dd6-d5fd-4d62-aa4d-602ce6573f1e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-98f79dd6-d5fd-4d62-aa4d-602ce6573f1e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:09:23.995011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:09:23.996200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:09:23.997261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 566/1165] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 10:09:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:09:24.002599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26fc50-0ea8-4617-af67-513bf4797f64 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:24.109982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26fc50-0ea8-4617-af67-513bf4797f64 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:24.145861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b09ba-56e4-49ae-86c9-d87bb1a0a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:24.146663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b09ba-56e4-49ae-86c9-d87bb1a0a574 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:24.146951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b09ba-56e4-49ae-86c9-d87bb1a0a574 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:24.147230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b09ba-56e4-49ae-86c9-d87bb1a0a574 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:24.148190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b09ba-56e4-49ae-86c9-d87bb1a0a574 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:24.148497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b09ba-56e4-49ae-86c9-d87bb1a0a574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:24.150074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b09ba-56e4-49ae-86c9-d87bb1a0a574 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:24.158420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 600/1166] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 10:09:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:26.134396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aedbd-e022-4733-a94d-42f4faa5e14e None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:26.135146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aedbd-e022-4733-a94d-42f4faa5e14e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:26.135146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aedbd-e022-4733-a94d-42f4faa5e14e None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:26.136359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 567/1167] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:26.141891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec523fbc-9a48-4b7d-b62b-dc66a0693ceb None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:26.142355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec523fbc-9a48-4b7d-b62b-dc66a0693ceb None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:26.142449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec523fbc-9a48-4b7d-b62b-dc66a0693ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:26.159809 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-ec523fbc-9a48-4b7d-b62b-dc66a0693ceb None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:26.160976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ec523fbc-9a48-4b7d-b62b-dc66a0693ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:26.168349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:26.230550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 601/1168] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:09:26.253741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aedbd-e022-4733-a94d-42f4faa5e14e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:26.361204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aedbd-e022-4733-a94d-42f4faa5e14e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:26.387878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:26.397398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e43fd-9f3b-449d-8cdc-bd8fae34f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:26.398065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e43fd-9f3b-449d-8cdc-bd8fae34f6da None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:26.398348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e43fd-9f3b-449d-8cdc-bd8fae34f6da None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:26.398669 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e43fd-9f3b-449d-8cdc-bd8fae34f6da None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:26.399426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e43fd-9f3b-449d-8cdc-bd8fae34f6da None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:26.400871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e43fd-9f3b-449d-8cdc-bd8fae34f6da None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:26.416309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 568/1169] 10.222.0.66 () {60 vars in 1138 bytes} [Wed Jun 22 10:09:26 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:09:28.457450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11bd1d-153c-4c07-92b8-b9c3724cc6b0 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:28.458015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11bd1d-153c-4c07-92b8-b9c3724cc6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:28.458015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11bd1d-153c-4c07-92b8-b9c3724cc6b0 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:28.459431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 602/1170] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:28.465199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48e806-e119-4ae8-a41e-cea0c6c4b230 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:28.465699 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48e806-e119-4ae8-a41e-cea0c6c4b230 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:28.465699 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48e806-e119-4ae8-a41e-cea0c6c4b230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:28.484264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2d48e806-e119-4ae8-a41e-cea0c6c4b230 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:28.485483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2d48e806-e119-4ae8-a41e-cea0c6c4b230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:28.560110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 569/1171] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:28.585305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11bd1d-153c-4c07-92b8-b9c3724cc6b0 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:28.705422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11bd1d-153c-4c07-92b8-b9c3724cc6b0 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:28.740814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800be8e-f2b9-4095-bb48-dfdb216080a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:28.741614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800be8e-f2b9-4095-bb48-dfdb216080a1 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:28.741897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800be8e-f2b9-4095-bb48-dfdb216080a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:28.742173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800be8e-f2b9-4095-bb48-dfdb216080a1 None admin] PATH_INFO: `/v3/domains/6cb8a49510384488968f5bca48058617` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:28.752730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800be8e-f2b9-4095-bb48-dfdb216080a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6cb8a49510384488968f5bca48058617)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:28.754188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800be8e-f2b9-4095-bb48-dfdb216080a1 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:28.755871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 603/1172] 10.222.0.66 () {56 vars in 1183 bytes} [Wed Jun 22 10:09:28 2022] GET /identity/v3/domains/6cb8a49510384488968f5bca48058617 => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:28.762819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48e806-e119-4ae8-a41e-cea0c6c4b230 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:28.889282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48e806-e119-4ae8-a41e-cea0c6c4b230 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:28.908891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:28.928464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922d8e8-8a26-4cd7-8983-4cd24346c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:28.929118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d8e8-8a26-4cd7-8983-4cd24346c979 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:28.929405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d8e8-8a26-4cd7-8983-4cd24346c979 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:28.929679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d8e8-8a26-4cd7-8983-4cd24346c979 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:28.930389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922d8e8-8a26-4cd7-8983-4cd24346c979 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:28.931889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922d8e8-8a26-4cd7-8983-4cd24346c979 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:28.959601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 570/1173] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:09:28 2022] POST /identity/v3/projects => generated 361 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:09:30.996728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c3be3-cdbb-46bc-b504-68293cbf3c37 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:30.997301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c3be3-cdbb-46bc-b504-68293cbf3c37 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:30.997301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c3be3-cdbb-46bc-b504-68293cbf3c37 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:30.998589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 604/1174] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:31.004245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281d77-a71d-4833-a15f-1475bca739fd None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:31.004732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281d77-a71d-4833-a15f-1475bca739fd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:31.004732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281d77-a71d-4833-a15f-1475bca739fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:31.022135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ad281d77-a71d-4833-a15f-1475bca739fd None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:31.023342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ad281d77-a71d-4833-a15f-1475bca739fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:31.092914 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 571/1175] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:09:31.117986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c3be3-cdbb-46bc-b504-68293cbf3c37 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:31.121208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:31.226529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c3be3-cdbb-46bc-b504-68293cbf3c37 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:31.262239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3b235-29bb-49b0-b2ab-a2bde81b1907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:31.263114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3b235-29bb-49b0-b2ab-a2bde81b1907 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:31.263393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3b235-29bb-49b0-b2ab-a2bde81b1907 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:31.263670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3b235-29bb-49b0-b2ab-a2bde81b1907 None admin] PATH_INFO: `/v3/domains/6cb8a49510384488968f5bca48058617` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:31.264884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3b235-29bb-49b0-b2ab-a2bde81b1907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6cb8a49510384488968f5bca48058617)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:31.266331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3b235-29bb-49b0-b2ab-a2bde81b1907 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:31.268014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 605/1176] 10.222.0.66 () {56 vars in 1183 bytes} [Wed Jun 22 10:09:31 2022] GET /identity/v3/domains/6cb8a49510384488968f5bca48058617 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:31.273905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad281d77-a71d-4833-a15f-1475bca739fd None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:31.380584 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:31.383862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad281d77-a71d-4833-a15f-1475bca739fd None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:31.419710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c7a00-c0a1-4613-9b66-78dfa34012d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:31.420379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c7a00-c0a1-4613-9b66-78dfa34012d6 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:31.420665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c7a00-c0a1-4613-9b66-78dfa34012d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:31.420941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c7a00-c0a1-4613-9b66-78dfa34012d6 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:31.421667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c7a00-c0a1-4613-9b66-78dfa34012d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:31.423146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c7a00-c0a1-4613-9b66-78dfa34012d6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:31.444769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 572/1177] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:09:31 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:09:33.490894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d97ea-39ee-44e2-a79e-33227e0b544c None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:33.491772 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d97ea-39ee-44e2-a79e-33227e0b544c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:33.491927 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d97ea-39ee-44e2-a79e-33227e0b544c None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:33.494108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 606/1178] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:33.500430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cfa2-d5ee-4d54-9bc5-58096489795c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:33.500919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cfa2-d5ee-4d54-9bc5-58096489795c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:33.501020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cfa2-d5ee-4d54-9bc5-58096489795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:33.521245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3da8cfa2-d5ee-4d54-9bc5-58096489795c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:33.522442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3da8cfa2-d5ee-4d54-9bc5-58096489795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:33.593721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 573/1179] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:09:33.617207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d97ea-39ee-44e2-a79e-33227e0b544c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:33.692012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:33.726365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d97ea-39ee-44e2-a79e-33227e0b544c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:33.763846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4051-b2a5-4e44-925e-c0e8704ac77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:33.764562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4051-b2a5-4e44-925e-c0e8704ac77b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:33.764844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4051-b2a5-4e44-925e-c0e8704ac77b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:33.765117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4051-b2a5-4e44-925e-c0e8704ac77b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:33.776351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb4051-b2a5-4e44-925e-c0e8704ac77b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-c3fb4051-b2a5-4e44-925e-c0e8704ac77b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:09:33.784117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:09:33.785275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:09:33.786348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 607/1180] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:09:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:09:33.793355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8cfa2-d5ee-4d54-9bc5-58096489795c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:33.882071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:33.898443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8cfa2-d5ee-4d54-9bc5-58096489795c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:33.933345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160385f-9fc2-4fd8-8ea7-76355e81e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:33.934005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160385f-9fc2-4fd8-8ea7-76355e81e841 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:33.934281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160385f-9fc2-4fd8-8ea7-76355e81e841 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:33.934549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160385f-9fc2-4fd8-8ea7-76355e81e841 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:33.935320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160385f-9fc2-4fd8-8ea7-76355e81e841 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:33.935617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160385f-9fc2-4fd8-8ea7-76355e81e841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:33.936976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160385f-9fc2-4fd8-8ea7-76355e81e841 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:33.945108 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 574/1181] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:09:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:09:33.951213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4051-b2a5-4e44-925e-c0e8704ac77b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:34.051822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4051-b2a5-4e44-925e-c0e8704ac77b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:34.080902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:34.087311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cf887-da3d-4ede-91c8-a62fdc45263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:34.088221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cf887-da3d-4ede-91c8-a62fdc45263b None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:34.088501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cf887-da3d-4ede-91c8-a62fdc45263b None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:34.088773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cf887-da3d-4ede-91c8-a62fdc45263b None admin] PATH_INFO: `/v3/users/78db189d8bf44f2ea6ffc6e98f88bc1b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:34.102074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cf887-da3d-4ede-91c8-a62fdc45263b None admin] RBAC: Authorizing `identity:get_user(user_id=78db189d8bf44f2ea6ffc6e98f88bc1b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:34.103696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cf887-da3d-4ede-91c8-a62fdc45263b None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:34.105446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 608/1182] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:33 2022] GET /identity/v3/users/78db189d8bf44f2ea6ffc6e98f88bc1b => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:34.111553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160385f-9fc2-4fd8-8ea7-76355e81e841 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:34.219547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160385f-9fc2-4fd8-8ea7-76355e81e841 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:34.254443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3defa9-77c7-49ef-aeb7-ce511adbbbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:34.255106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3defa9-77c7-49ef-aeb7-ce511adbbbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:34.255379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3defa9-77c7-49ef-aeb7-ce511adbbbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:34.255647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3defa9-77c7-49ef-aeb7-ce511adbbbb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:34.273322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:34.338126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3defa9-77c7-49ef-aeb7-ce511adbbbb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:34.339526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3defa9-77c7-49ef-aeb7-ce511adbbbb9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:34.442944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 575/1183] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:09:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:34.449510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cf887-da3d-4ede-91c8-a62fdc45263b None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:34.550374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cf887-da3d-4ede-91c8-a62fdc45263b None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:34.585946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597cb07-06a5-4b1b-af28-b9d308892666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:34.586874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597cb07-06a5-4b1b-af28-b9d308892666 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:34.587176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597cb07-06a5-4b1b-af28-b9d308892666 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:34.587446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597cb07-06a5-4b1b-af28-b9d308892666 None admin] PATH_INFO: `/v3/projects/456a6f2fa1d040459a2f08c5b2caa88c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:34.588914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597cb07-06a5-4b1b-af28-b9d308892666 None admin] RBAC: Authorizing `identity:get_project(project_id=456a6f2fa1d040459a2f08c5b2caa88c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:34.590343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597cb07-06a5-4b1b-af28-b9d308892666 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:34.592140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 609/1184] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:09:34 2022] GET /identity/v3/projects/456a6f2fa1d040459a2f08c5b2caa88c => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:34.598610 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3defa9-77c7-49ef-aeb7-ce511adbbbb9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:34.654026 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:34.707946 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3defa9-77c7-49ef-aeb7-ce511adbbbb9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:34.750538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf3a1c-477a-41ca-8a32-ec6adef0b210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:34.751193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3a1c-477a-41ca-8a32-ec6adef0b210 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:34.751476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3a1c-477a-41ca-8a32-ec6adef0b210 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:34.751750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3a1c-477a-41ca-8a32-ec6adef0b210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:34.752583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf3a1c-477a-41ca-8a32-ec6adef0b210 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=456a6f2fa1d040459a2f08c5b2caa88c, user.id=78db189d8bf44f2ea6ffc6e98f88bc1b) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:34.752895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf3a1c-477a-41ca-8a32-ec6adef0b210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:34.754337 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf3a1c-477a-41ca-8a32-ec6adef0b210 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:34.760005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 576/1185] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:09:34 2022] GET /identity/v3/role_assignments?user.id=78db189d8bf44f2ea6ffc6e98f88bc1b&scope.project.id=456a6f2fa1d040459a2f08c5b2caa88c&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:36.742135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cdbad-90f6-43d2-9501-03ff41eed61e None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:36.742732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cdbad-90f6-43d2-9501-03ff41eed61e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:36.742732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cdbad-90f6-43d2-9501-03ff41eed61e None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:36.744190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 610/1186] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:36.749351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bfbfa-1bd9-47d7-a5d4-e420d3cd22e3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:36.749774 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bfbfa-1bd9-47d7-a5d4-e420d3cd22e3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:36.749863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bfbfa-1bd9-47d7-a5d4-e420d3cd22e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:36.766870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9e3bfbfa-1bd9-47d7-a5d4-e420d3cd22e3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:36.768035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9e3bfbfa-1bd9-47d7-a5d4-e420d3cd22e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:36.841465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 577/1187] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:36.864238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cdbad-90f6-43d2-9501-03ff41eed61e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:36.922353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:36.970532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cdbad-90f6-43d2-9501-03ff41eed61e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:37.007396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8e8ef-a22c-4355-aa1e-b47c2d2db788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:37.008194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8e8ef-a22c-4355-aa1e-b47c2d2db788 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:37.008474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8e8ef-a22c-4355-aa1e-b47c2d2db788 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:37.008749 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8e8ef-a22c-4355-aa1e-b47c2d2db788 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:37.019987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8e8ef-a22c-4355-aa1e-b47c2d2db788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-0de8e8ef-a22c-4355-aa1e-b47c2d2db788 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:09:37.027611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:09:37.028838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:37.029955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:09:37.037547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 611/1188] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:09:37.037719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bfbfa-1bd9-47d7-a5d4-e420d3cd22e3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:37.080263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:37.141269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bfbfa-1bd9-47d7-a5d4-e420d3cd22e3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:37.178845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30f489-c069-42d3-8818-5a0b2ae4ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:37.179413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30f489-c069-42d3-8818-5a0b2ae4ab1e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:37.179690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30f489-c069-42d3-8818-5a0b2ae4ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:37.179954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30f489-c069-42d3-8818-5a0b2ae4ab1e None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:37.180707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30f489-c069-42d3-8818-5a0b2ae4ab1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:37.181004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30f489-c069-42d3-8818-5a0b2ae4ab1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:37.182408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30f489-c069-42d3-8818-5a0b2ae4ab1e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:37.191769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 578/1189] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:09:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:37.198065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8e8ef-a22c-4355-aa1e-b47c2d2db788 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:37.304970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8e8ef-a22c-4355-aa1e-b47c2d2db788 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:37.324312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:37.345078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64d7f2-6d88-4f4a-a630-a756e24a04ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:37.345964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64d7f2-6d88-4f4a-a630-a756e24a04ff None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:37.346245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64d7f2-6d88-4f4a-a630-a756e24a04ff None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:37.346547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64d7f2-6d88-4f4a-a630-a756e24a04ff None admin] PATH_INFO: `/v3/users/78db189d8bf44f2ea6ffc6e98f88bc1b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:37.347821 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64d7f2-6d88-4f4a-a630-a756e24a04ff None admin] RBAC: Authorizing `identity:get_user(user_id=78db189d8bf44f2ea6ffc6e98f88bc1b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:37.349270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64d7f2-6d88-4f4a-a630-a756e24a04ff None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:37.350976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 612/1190] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:37 2022] GET /identity/v3/users/78db189d8bf44f2ea6ffc6e98f88bc1b => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:37.357231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30f489-c069-42d3-8818-5a0b2ae4ab1e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:37.461968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30f489-c069-42d3-8818-5a0b2ae4ab1e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:37.464856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:37.499709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96b81-6ea8-4b7f-89e2-8a01fabe8603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:37.500578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96b81-6ea8-4b7f-89e2-8a01fabe8603 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:37.500850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96b81-6ea8-4b7f-89e2-8a01fabe8603 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:37.501120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96b81-6ea8-4b7f-89e2-8a01fabe8603 None admin] PATH_INFO: `/v3/projects/456a6f2fa1d040459a2f08c5b2caa88c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:37.502347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b96b81-6ea8-4b7f-89e2-8a01fabe8603 None admin] RBAC: Authorizing `identity:get_project(project_id=456a6f2fa1d040459a2f08c5b2caa88c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:37.503825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b96b81-6ea8-4b7f-89e2-8a01fabe8603 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:37.505541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 579/1191] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:09:37 2022] GET /identity/v3/projects/456a6f2fa1d040459a2f08c5b2caa88c => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:37.511747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64d7f2-6d88-4f4a-a630-a756e24a04ff None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:37.617607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64d7f2-6d88-4f4a-a630-a756e24a04ff None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:37.653371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4744e8-1d1c-40c3-9173-7a6410f219bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:37.654260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4744e8-1d1c-40c3-9173-7a6410f219bf None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:37.654531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4744e8-1d1c-40c3-9173-7a6410f219bf None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:37.654830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4744e8-1d1c-40c3-9173-7a6410f219bf None admin] PATH_INFO: `/v3/projects/456a6f2fa1d040459a2f08c5b2caa88c/users/78db189d8bf44f2ea6ffc6e98f88bc1b/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:37.658535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4744e8-1d1c-40c3-9173-7a6410f219bf None admin] RBAC: Authorizing `identity:create_grant(project_id=456a6f2fa1d040459a2f08c5b2caa88c, user_id=78db189d8bf44f2ea6ffc6e98f88bc1b, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:37.660744 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4744e8-1d1c-40c3-9173-7a6410f219bf None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:37.680886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 613/1192] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:09:37 2022] PUT /identity/v3/projects/456a6f2fa1d040459a2f08c5b2caa88c/users/78db189d8bf44f2ea6ffc6e98f88bc1b/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:09:39.681941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2bb65-0e3c-47ea-9b4c-4d4da47318c4 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:39.682535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2bb65-0e3c-47ea-9b4c-4d4da47318c4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:39.682535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2bb65-0e3c-47ea-9b4c-4d4da47318c4 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:39.683879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 580/1193] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:39.689390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbcc5c-1451-434a-bab3-ec63c88061df None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:39.689857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbcc5c-1451-434a-bab3-ec63c88061df None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:39.689959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbcc5c-1451-434a-bab3-ec63c88061df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:39.710878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8ebbcc5c-1451-434a-bab3-ec63c88061df None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:39.712050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8ebbcc5c-1451-434a-bab3-ec63c88061df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:39.752742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:39.784168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 614/1194] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:09:39.807654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2bb65-0e3c-47ea-9b4c-4d4da47318c4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:39.915090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2bb65-0e3c-47ea-9b4c-4d4da47318c4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:39.950386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d2c3d-bd19-41a5-8fe8-6d6355932304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:39.951202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d2c3d-bd19-41a5-8fe8-6d6355932304 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:39.951480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d2c3d-bd19-41a5-8fe8-6d6355932304 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:39.951749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d2c3d-bd19-41a5-8fe8-6d6355932304 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:39.963213 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d2c3d-bd19-41a5-8fe8-6d6355932304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-126d2c3d-bd19-41a5-8fe8-6d6355932304 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:09:39.970635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:09:39.971740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:09:39.972790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:09:39.974695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 581/1195] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:09:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:09:39.977925 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbcc5c-1451-434a-bab3-ec63c88061df None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:40.080514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbcc5c-1451-434a-bab3-ec63c88061df None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:40.116344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805340-554e-4305-be5a-07332d8a303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:40.117019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805340-554e-4305-be5a-07332d8a303e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:40.117310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805340-554e-4305-be5a-07332d8a303e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:40.117587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805340-554e-4305-be5a-07332d8a303e None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:40.118340 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805340-554e-4305-be5a-07332d8a303e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:40.118687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805340-554e-4305-be5a-07332d8a303e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:40.120114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805340-554e-4305-be5a-07332d8a303e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:40.128590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 615/1196] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:09:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:40.134738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d2c3d-bd19-41a5-8fe8-6d6355932304 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:40.168784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:40.254718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d2c3d-bd19-41a5-8fe8-6d6355932304 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:40.291688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd41230-0768-4123-aeeb-187b1b286649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:40.292571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd41230-0768-4123-aeeb-187b1b286649 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:40.292838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd41230-0768-4123-aeeb-187b1b286649 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:40.293111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd41230-0768-4123-aeeb-187b1b286649 None admin] PATH_INFO: `/v3/users/78db189d8bf44f2ea6ffc6e98f88bc1b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:40.294388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd41230-0768-4123-aeeb-187b1b286649 None admin] RBAC: Authorizing `identity:get_user(user_id=78db189d8bf44f2ea6ffc6e98f88bc1b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:40.295886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd41230-0768-4123-aeeb-187b1b286649 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:40.297551 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 582/1197] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 10:09:40 2022] GET /identity/v3/users/78db189d8bf44f2ea6ffc6e98f88bc1b => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:40.306465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805340-554e-4305-be5a-07332d8a303e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:40.344791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:40.416337 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805340-554e-4305-be5a-07332d8a303e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:40.461009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5be95-000b-49a7-b4b8-504c6a8499c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:40.461571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5be95-000b-49a7-b4b8-504c6a8499c0 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:40.461855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5be95-000b-49a7-b4b8-504c6a8499c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:40.462179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5be95-000b-49a7-b4b8-504c6a8499c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:40.533393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5be95-000b-49a7-b4b8-504c6a8499c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:40.534874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5be95-000b-49a7-b4b8-504c6a8499c0 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:40.570975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:40.640684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 616/1198] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:09:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:40.646750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd41230-0768-4123-aeeb-187b1b286649 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:40.754923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:40.758234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd41230-0768-4123-aeeb-187b1b286649 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:40.795369 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7043a-4dc3-44c1-9aed-3b36c4729fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:40.796230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7043a-4dc3-44c1-9aed-3b36c4729fdd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:40.796509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7043a-4dc3-44c1-9aed-3b36c4729fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:40.796788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7043a-4dc3-44c1-9aed-3b36c4729fdd None admin] PATH_INFO: `/v3/projects/456a6f2fa1d040459a2f08c5b2caa88c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:40.798009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7043a-4dc3-44c1-9aed-3b36c4729fdd None admin] RBAC: Authorizing `identity:get_project(project_id=456a6f2fa1d040459a2f08c5b2caa88c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:40.799484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7043a-4dc3-44c1-9aed-3b36c4729fdd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:40.801209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 583/1199] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 10:09:40 2022] GET /identity/v3/projects/456a6f2fa1d040459a2f08c5b2caa88c => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:40.807730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5be95-000b-49a7-b4b8-504c6a8499c0 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:40.912448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5be95-000b-49a7-b4b8-504c6a8499c0 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:40.947545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a189b23-235e-4552-9bb2-b436870ce84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:40.948189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a189b23-235e-4552-9bb2-b436870ce84d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:40.948466 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a189b23-235e-4552-9bb2-b436870ce84d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:40.948736 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a189b23-235e-4552-9bb2-b436870ce84d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:40.949565 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a189b23-235e-4552-9bb2-b436870ce84d None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=456a6f2fa1d040459a2f08c5b2caa88c, user.id=78db189d8bf44f2ea6ffc6e98f88bc1b) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:09:40.949869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a189b23-235e-4552-9bb2-b436870ce84d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:40.951345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a189b23-235e-4552-9bb2-b436870ce84d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:40.954281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:40.957710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 617/1200] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:09:40 2022] GET /identity/v3/role_assignments?user.id=78db189d8bf44f2ea6ffc6e98f88bc1b&scope.project.id=456a6f2fa1d040459a2f08c5b2caa88c&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:09:50.790204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=16 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:36.527340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810feb0a-40d8-49e5-9b2b-440ca465f46b None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:36.528181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810feb0a-40d8-49e5-9b2b-440ca465f46b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:36.528181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810feb0a-40d8-49e5-9b2b-440ca465f46b None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:36.529294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 584/1201] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:36.537263 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd5ebf-efc4-449d-bbdb-c990498b75c5 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:36.537868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd5ebf-efc4-449d-bbdb-c990498b75c5 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:36.537868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd5ebf-efc4-449d-bbdb-c990498b75c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:36.557591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-cdcd5ebf-efc4-449d-bbdb-c990498b75c5 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:36.561077 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cdcd5ebf-efc4-449d-bbdb-c990498b75c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:36.660594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 618/1202] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:10:36.688415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810feb0a-40d8-49e5-9b2b-440ca465f46b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:36.837381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810feb0a-40d8-49e5-9b2b-440ca465f46b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:36.883332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05cc9-59f3-47a4-82c1-26ff308abb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:36.884238 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05cc9-59f3-47a4-82c1-26ff308abb62 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:36.884531 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05cc9-59f3-47a4-82c1-26ff308abb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:36.884796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05cc9-59f3-47a4-82c1-26ff308abb62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:36.908504 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05cc9-59f3-47a4-82c1-26ff308abb62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:36.909183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05cc9-59f3-47a4-82c1-26ff308abb62 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-13c05cc9-59f3-47a4-82c1-26ff308abb62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:36.933969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:36.935112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:36.941178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:36.941178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:36.941178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:36.941178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:36.941178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 585/1203] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:36.943800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd5ebf-efc4-449d-bbdb-c990498b75c5 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:37.089007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd5ebf-efc4-449d-bbdb-c990498b75c5 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:37.141179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:37.153401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598bf21-e20e-4acc-8577-4bfd29a45fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:37.154680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598bf21-e20e-4acc-8577-4bfd29a45fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:37.155166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598bf21-e20e-4acc-8577-4bfd29a45fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:37.155625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598bf21-e20e-4acc-8577-4bfd29a45fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:37.157704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598bf21-e20e-4acc-8577-4bfd29a45fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:37.158269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598bf21-e20e-4acc-8577-4bfd29a45fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:37.161311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598bf21-e20e-4acc-8577-4bfd29a45fc7 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:37.187303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 619/1204] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:37.196189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05cc9-59f3-47a4-82c1-26ff308abb62 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:37.265372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:37.332296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05cc9-59f3-47a4-82c1-26ff308abb62 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:37.381740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22656389-469e-463f-acd8-57949d0735e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:37.382701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22656389-469e-463f-acd8-57949d0735e8 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:37.383219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22656389-469e-463f-acd8-57949d0735e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:37.383705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22656389-469e-463f-acd8-57949d0735e8 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:37.384728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22656389-469e-463f-acd8-57949d0735e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:37.386385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22656389-469e-463f-acd8-57949d0735e8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:37.422543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 586/1205] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 10:10:37 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:10:39.587151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b194-43ea-49f8-8f15-22b19a01ba7c None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:39.587778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b194-43ea-49f8-8f15-22b19a01ba7c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:39.588087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b194-43ea-49f8-8f15-22b19a01ba7c None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:39.594368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 620/1206] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:10:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:39.596972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec561b4-08a8-4f94-81eb-9777c13883e0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:39.597712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec561b4-08a8-4f94-81eb-9777c13883e0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:39.597877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec561b4-08a8-4f94-81eb-9777c13883e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:39.619751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-eec561b4-08a8-4f94-81eb-9777c13883e0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:39.620968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eec561b4-08a8-4f94-81eb-9777c13883e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:39.708081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 587/1207] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:10:39.732105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b194-43ea-49f8-8f15-22b19a01ba7c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:39.853889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b194-43ea-49f8-8f15-22b19a01ba7c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:39.895809 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af795738-4678-4ccf-8e99-8f00e3b68b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:39.896703 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795738-4678-4ccf-8e99-8f00e3b68b42 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:39.897046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795738-4678-4ccf-8e99-8f00e3b68b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:39.897802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795738-4678-4ccf-8e99-8f00e3b68b42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:39.911910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af795738-4678-4ccf-8e99-8f00e3b68b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-af795738-4678-4ccf-8e99-8f00e3b68b42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:10:39.920440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:39.921465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:39.923004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 621/1208] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:10:39.927911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec561b4-08a8-4f94-81eb-9777c13883e0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:39.972933 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:40.047898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec561b4-08a8-4f94-81eb-9777c13883e0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:40.085106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033d28-40c7-4224-911a-8575fc58fa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:40.085889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033d28-40c7-4224-911a-8575fc58fa55 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:40.086081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033d28-40c7-4224-911a-8575fc58fa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:40.086388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033d28-40c7-4224-911a-8575fc58fa55 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:40.087172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033d28-40c7-4224-911a-8575fc58fa55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:40.087475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033d28-40c7-4224-911a-8575fc58fa55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:40.088947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033d28-40c7-4224-911a-8575fc58fa55 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:40.098775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 588/1209] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:10:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:40.104768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af795738-4678-4ccf-8e99-8f00e3b68b42 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:40.198186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:40.263016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af795738-4678-4ccf-8e99-8f00e3b68b42 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:40.299832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfbbb8-8a58-437c-9671-2c3b37d07eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:40.300685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfbbb8-8a58-437c-9671-2c3b37d07eab None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:40.300969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfbbb8-8a58-437c-9671-2c3b37d07eab None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:40.301208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfbbb8-8a58-437c-9671-2c3b37d07eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:40.313463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfbbb8-8a58-437c-9671-2c3b37d07eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:40.315039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfbbb8-8a58-437c-9671-2c3b37d07eab None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-08cfbbb8-8a58-437c-9671-2c3b37d07eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:40.334268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:40.335677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:40.336722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:40.336722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:40.336722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:40.336722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:40.336722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 622/1210] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:40.341856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033d28-40c7-4224-911a-8575fc58fa55 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:40.457231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:40.461584 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033d28-40c7-4224-911a-8575fc58fa55 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:40.504786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237642-45a8-4778-b1b7-a06713a14c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:40.505490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237642-45a8-4778-b1b7-a06713a14c97 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:40.505769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237642-45a8-4778-b1b7-a06713a14c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:40.506041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237642-45a8-4778-b1b7-a06713a14c97 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:40.506864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea237642-45a8-4778-b1b7-a06713a14c97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:40.507169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea237642-45a8-4778-b1b7-a06713a14c97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:40.508634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea237642-45a8-4778-b1b7-a06713a14c97 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:40.522895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 589/1211] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:40.528796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfbbb8-8a58-437c-9671-2c3b37d07eab None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:40.653551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfbbb8-8a58-437c-9671-2c3b37d07eab None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:40.655491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:40.693445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569163b-613f-41a7-8c11-122ca390dff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:40.694245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569163b-613f-41a7-8c11-122ca390dff4 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:40.694557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569163b-613f-41a7-8c11-122ca390dff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:40.694854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569163b-613f-41a7-8c11-122ca390dff4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:40.702816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569163b-613f-41a7-8c11-122ca390dff4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:40.704301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569163b-613f-41a7-8c11-122ca390dff4 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-1569163b-613f-41a7-8c11-122ca390dff4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:10:40.719941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:40.721150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:40.722754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 623/1212] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:40.727917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237642-45a8-4778-b1b7-a06713a14c97 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:40.849786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237642-45a8-4778-b1b7-a06713a14c97 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:40.897877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5e29b-4b72-4e9e-af9e-d9e029ec625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:40.898848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5e29b-4b72-4e9e-af9e-d9e029ec625a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:40.899234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5e29b-4b72-4e9e-af9e-d9e029ec625a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:40.899612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5e29b-4b72-4e9e-af9e-d9e029ec625a None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:40.900623 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5e29b-4b72-4e9e-af9e-d9e029ec625a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:40.901019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5e29b-4b72-4e9e-af9e-d9e029ec625a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:40.902630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5e29b-4b72-4e9e-af9e-d9e029ec625a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:40.924211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 590/1213] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 10:10:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:40.930515 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569163b-613f-41a7-8c11-122ca390dff4 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:41.051103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569163b-613f-41a7-8c11-122ca390dff4 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:41.095283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcda987-373d-4c8b-a2b1-e55b8d079e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:41.095968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcda987-373d-4c8b-a2b1-e55b8d079e6c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:41.096254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcda987-373d-4c8b-a2b1-e55b8d079e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:41.096534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcda987-373d-4c8b-a2b1-e55b8d079e6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:41.135389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:41.189484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcda987-373d-4c8b-a2b1-e55b8d079e6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:41.191150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcda987-373d-4c8b-a2b1-e55b8d079e6c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:41.314577 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 624/1214] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:10:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:10:41.320881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5e29b-4b72-4e9e-af9e-d9e029ec625a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:41.348584 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:41.462080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5e29b-4b72-4e9e-af9e-d9e029ec625a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:41.501630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86424dc8-15a7-4dfd-8935-25032ddb7a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:41.502439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86424dc8-15a7-4dfd-8935-25032ddb7a11 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:41.502751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86424dc8-15a7-4dfd-8935-25032ddb7a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:41.503016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86424dc8-15a7-4dfd-8935-25032ddb7a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:41.514580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86424dc8-15a7-4dfd-8935-25032ddb7a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:41.516293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86424dc8-15a7-4dfd-8935-25032ddb7a11 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-86424dc8-15a7-4dfd-8935-25032ddb7a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:41.536166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:41.538782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:41.540048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:41.540048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:41.540048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:41.540048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:41.540048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 591/1215] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:41.543499 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcda987-373d-4c8b-a2b1-e55b8d079e6c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:41.625578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:41.678444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcda987-373d-4c8b-a2b1-e55b8d079e6c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:41.716611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e259754-d76f-48c9-83a3-feab3957427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:41.717296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e259754-d76f-48c9-83a3-feab3957427e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:41.717584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e259754-d76f-48c9-83a3-feab3957427e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:41.717853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e259754-d76f-48c9-83a3-feab3957427e None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:41.718631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e259754-d76f-48c9-83a3-feab3957427e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:41.720730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e259754-d76f-48c9-83a3-feab3957427e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:41.720730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e259754-d76f-48c9-83a3-feab3957427e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:41.733203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 625/1216] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:10:41.738898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86424dc8-15a7-4dfd-8935-25032ddb7a11 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:41.828332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:41.866378 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86424dc8-15a7-4dfd-8935-25032ddb7a11 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:41.916414 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624283f5-1bf4-4daa-ae0d-df830ec4b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:41.918454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624283f5-1bf4-4daa-ae0d-df830ec4b2ab None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:41.918454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624283f5-1bf4-4daa-ae0d-df830ec4b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:41.918454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624283f5-1bf4-4daa-ae0d-df830ec4b2ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:41.926470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624283f5-1bf4-4daa-ae0d-df830ec4b2ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:41.928169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624283f5-1bf4-4daa-ae0d-df830ec4b2ab None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-624283f5-1bf4-4daa-ae0d-df830ec4b2ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:10:41.943276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:41.944312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:41.945320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:10:41.945320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:10:41.945320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:10:41.945320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:10:41.945320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:10:41.945320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:10:41.945320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:10:41.945320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:41.950657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 592/1217] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:41.950950 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e259754-d76f-48c9-83a3-feab3957427e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:42.065505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e259754-d76f-48c9-83a3-feab3957427e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:42.090919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:42.103326 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f94fc-10e5-4b7b-bd5c-8f28535ecbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:42.104002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f94fc-10e5-4b7b-bd5c-8f28535ecbde None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:42.104303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f94fc-10e5-4b7b-bd5c-8f28535ecbde None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:42.104590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f94fc-10e5-4b7b-bd5c-8f28535ecbde None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:42.105385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f94fc-10e5-4b7b-bd5c-8f28535ecbde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:42.105694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f94fc-10e5-4b7b-bd5c-8f28535ecbde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:42.107189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f94fc-10e5-4b7b-bd5c-8f28535ecbde None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:42.126386 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 626/1218] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:42.126643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624283f5-1bf4-4daa-ae0d-df830ec4b2ab None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:42.263563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624283f5-1bf4-4daa-ae0d-df830ec4b2ab None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:42.302129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:42.310665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ce32-c7b3-4bac-9ee6-d2f54021c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:42.311732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ce32-c7b3-4bac-9ee6-d2f54021c104 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:42.312164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ce32-c7b3-4bac-9ee6-d2f54021c104 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:42.312618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ce32-c7b3-4bac-9ee6-d2f54021c104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:42.313605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ce32-c7b3-4bac-9ee6-d2f54021c104 None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=9b257dee0ca3400f860ef9bd8c7a4e4b) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:42.314081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ce32-c7b3-4bac-9ee6-d2f54021c104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:42.316115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ce32-c7b3-4bac-9ee6-d2f54021c104 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:42.323398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 593/1219] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:10:42 2022] GET /identity/v3/role_assignments?user.id=9b257dee0ca3400f860ef9bd8c7a4e4b&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:44.418793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecf410-82a3-41f8-a8b1-ee814042cee1 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:44.419380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecf410-82a3-41f8-a8b1-ee814042cee1 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:44.419380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecf410-82a3-41f8-a8b1-ee814042cee1 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:44.420784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 627/1220] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:44.426903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284a948-8b2f-4952-babe-c10c107ed091 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:44.427432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284a948-8b2f-4952-babe-c10c107ed091 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:44.427432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284a948-8b2f-4952-babe-c10c107ed091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:44.448126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5284a948-8b2f-4952-babe-c10c107ed091 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:44.449344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5284a948-8b2f-4952-babe-c10c107ed091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:44.538542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 594/1221] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:10:44.551313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecf410-82a3-41f8-a8b1-ee814042cee1 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:44.671754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecf410-82a3-41f8-a8b1-ee814042cee1 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:44.710738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7611-3878-41d5-b155-5ff07dac42a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:44.711532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7611-3878-41d5-b155-5ff07dac42a7 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:44.711832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7611-3878-41d5-b155-5ff07dac42a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:44.712088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7611-3878-41d5-b155-5ff07dac42a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:44.723525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c7611-3878-41d5-b155-5ff07dac42a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-1f6c7611-3878-41d5-b155-5ff07dac42a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:10:44.732034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:44.733355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:44.734413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 628/1222] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:10:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:44.739869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284a948-8b2f-4952-babe-c10c107ed091 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:44.851753 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284a948-8b2f-4952-babe-c10c107ed091 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:44.881501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:44.902229 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337834d-4920-4896-9c82-1a202d3cca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:44.903070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337834d-4920-4896-9c82-1a202d3cca56 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:44.903250 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337834d-4920-4896-9c82-1a202d3cca56 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:44.903560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337834d-4920-4896-9c82-1a202d3cca56 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:44.904270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337834d-4920-4896-9c82-1a202d3cca56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:44.904571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337834d-4920-4896-9c82-1a202d3cca56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:44.905955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337834d-4920-4896-9c82-1a202d3cca56 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:44.915566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 595/1223] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:10:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:10:44.921672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7611-3878-41d5-b155-5ff07dac42a7 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:44.969332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:45.032900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7611-3878-41d5-b155-5ff07dac42a7 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:45.074227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0915fe2-8814-4073-b645-3104a2fcf71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:45.075076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915fe2-8814-4073-b645-3104a2fcf71c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:45.075360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915fe2-8814-4073-b645-3104a2fcf71c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:45.075637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915fe2-8814-4073-b645-3104a2fcf71c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:45.087695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0915fe2-8814-4073-b645-3104a2fcf71c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:45.089198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0915fe2-8814-4073-b645-3104a2fcf71c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-a0915fe2-8814-4073-b645-3104a2fcf71c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:45.108619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:45.109672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:45.110644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:45.110644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:45.110644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:45.110644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:45.110644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 629/1224] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:45.116131 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337834d-4920-4896-9c82-1a202d3cca56 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:45.225800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337834d-4920-4896-9c82-1a202d3cca56 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:45.258985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfe0c8-865f-42a6-938e-7293b946be5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:45.259653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfe0c8-865f-42a6-938e-7293b946be5f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:45.259974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfe0c8-865f-42a6-938e-7293b946be5f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:45.260269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfe0c8-865f-42a6-938e-7293b946be5f None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:45.261047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfe0c8-865f-42a6-938e-7293b946be5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:45.261399 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfe0c8-865f-42a6-938e-7293b946be5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:45.262946 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfe0c8-865f-42a6-938e-7293b946be5f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:45.276092 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 596/1225] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:45.282915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0915fe2-8814-4073-b645-3104a2fcf71c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:45.389822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:45.397114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0915fe2-8814-4073-b645-3104a2fcf71c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:45.435240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fa0a3-fac4-4d7d-945b-c999dcf776f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:45.436063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fa0a3-fac4-4d7d-945b-c999dcf776f1 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:45.436346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fa0a3-fac4-4d7d-945b-c999dcf776f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:45.436622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fa0a3-fac4-4d7d-945b-c999dcf776f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:45.445206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fa0a3-fac4-4d7d-945b-c999dcf776f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:45.446728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fa0a3-fac4-4d7d-945b-c999dcf776f1 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-183fa0a3-fac4-4d7d-945b-c999dcf776f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:10:45.462347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:45.463681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:45.464884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 630/1226] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:45.469733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfe0c8-865f-42a6-938e-7293b946be5f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:45.523208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:45.597975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfe0c8-865f-42a6-938e-7293b946be5f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:45.637338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f30aff-2165-45c7-8547-c33a0fcd297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:45.638164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f30aff-2165-45c7-8547-c33a0fcd297e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:45.638449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f30aff-2165-45c7-8547-c33a0fcd297e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:45.638735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f30aff-2165-45c7-8547-c33a0fcd297e None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:45.639739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f30aff-2165-45c7-8547-c33a0fcd297e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:45.640100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f30aff-2165-45c7-8547-c33a0fcd297e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:45.641718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f30aff-2165-45c7-8547-c33a0fcd297e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:45.660818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 597/1227] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 10:10:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:45.666912 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fa0a3-fac4-4d7d-945b-c999dcf776f1 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:45.780647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fa0a3-fac4-4d7d-945b-c999dcf776f1 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:45.818270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f92a6-25e5-4c71-9183-1e7eaf462c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:45.819160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f92a6-25e5-4c71-9183-1e7eaf462c42 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:45.819831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f92a6-25e5-4c71-9183-1e7eaf462c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:45.820109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f92a6-25e5-4c71-9183-1e7eaf462c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:45.834076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f92a6-25e5-4c71-9183-1e7eaf462c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:45.835970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f92a6-25e5-4c71-9183-1e7eaf462c42 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-551f92a6-25e5-4c71-9183-1e7eaf462c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:45.855391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:45.856520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:45.857505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:45.857505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:45.857505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:45.857505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:45.857505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 631/1228] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:45.862704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f30aff-2165-45c7-8547-c33a0fcd297e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:45.983294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f30aff-2165-45c7-8547-c33a0fcd297e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:45.986335 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:46.025268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0e1a8-16ea-4702-a51f-07d27a628435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:46.025946 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0e1a8-16ea-4702-a51f-07d27a628435 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:46.026226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0e1a8-16ea-4702-a51f-07d27a628435 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:46.026552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0e1a8-16ea-4702-a51f-07d27a628435 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:46.027265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0e1a8-16ea-4702-a51f-07d27a628435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:46.027641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0e1a8-16ea-4702-a51f-07d27a628435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:46.029161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0e1a8-16ea-4702-a51f-07d27a628435 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:46.043919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 598/1229] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:46.049757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f92a6-25e5-4c71-9183-1e7eaf462c42 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:46.060720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:46.172534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f92a6-25e5-4c71-9183-1e7eaf462c42 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:46.227474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ec2e2-a4a7-4670-a22d-19b38c16b7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:46.228361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ec2e2-a4a7-4670-a22d-19b38c16b7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:46.228648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ec2e2-a4a7-4670-a22d-19b38c16b7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:46.228989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ec2e2-a4a7-4670-a22d-19b38c16b7b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:46.237992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ec2e2-a4a7-4670-a22d-19b38c16b7b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:46.239747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ec2e2-a4a7-4670-a22d-19b38c16b7b7 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-332ec2e2-a4a7-4670-a22d-19b38c16b7b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:10:46.256192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:46.257232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:46.258218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:10:46.258218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:10:46.258218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:10:46.258218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:10:46.258218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:10:46.258218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:10:46.258218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:10:46.258218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:46.258218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 632/1230] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:46.265016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0e1a8-16ea-4702-a51f-07d27a628435 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:46.400533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0e1a8-16ea-4702-a51f-07d27a628435 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:46.440145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c571e-0dd3-420b-9444-205ef72d7479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:46.441008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c571e-0dd3-420b-9444-205ef72d7479 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:46.441322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c571e-0dd3-420b-9444-205ef72d7479 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:46.441653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c571e-0dd3-420b-9444-205ef72d7479 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:46.442739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c571e-0dd3-420b-9444-205ef72d7479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:46.443083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c571e-0dd3-420b-9444-205ef72d7479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:46.444756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c571e-0dd3-420b-9444-205ef72d7479 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:46.457629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 599/1231] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:46.464226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ec2e2-a4a7-4670-a22d-19b38c16b7b7 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:46.538298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:46.577554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ec2e2-a4a7-4670-a22d-19b38c16b7b7 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:46.619866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146120b-811d-40fc-8472-bb9a80457ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:46.619866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146120b-811d-40fc-8472-bb9a80457ab2 None admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:46.620294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146120b-811d-40fc-8472-bb9a80457ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:46.620294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146120b-811d-40fc-8472-bb9a80457ab2 None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/9b257dee0ca3400f860ef9bd8c7a4e4b/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:46.641560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146120b-811d-40fc-8472-bb9a80457ab2 None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=9b257dee0ca3400f860ef9bd8c7a4e4b, role_id=111ab6c88aad4c2b96cc3d7ada1e2dc3)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:46.644461 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146120b-811d-40fc-8472-bb9a80457ab2 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:46.662006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 633/1232] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:10:46 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/9b257dee0ca3400f860ef9bd8c7a4e4b/roles/111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:10:48.934609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ed35-f1c0-4c50-9d4b-63affc4af288 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:48.935180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ed35-f1c0-4c50-9d4b-63affc4af288 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:48.935180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ed35-f1c0-4c50-9d4b-63affc4af288 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:48.937994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 600/1233] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:10:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:48.946833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386faa4-d3ae-4909-b0b3-ca634f62ebd9 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:48.947631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386faa4-d3ae-4909-b0b3-ca634f62ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:48.947821 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386faa4-d3ae-4909-b0b3-ca634f62ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:48.967026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d386faa4-d3ae-4909-b0b3-ca634f62ebd9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:48.968407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d386faa4-d3ae-4909-b0b3-ca634f62ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:49.044234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 634/1234] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:10:49.067987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ed35-f1c0-4c50-9d4b-63affc4af288 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:49.094124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:49.181197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ed35-f1c0-4c50-9d4b-63affc4af288 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:49.222016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052424f-ef53-47df-9d72-01a8885c004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:49.222767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052424f-ef53-47df-9d72-01a8885c004f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:49.223047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052424f-ef53-47df-9d72-01a8885c004f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:49.223318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052424f-ef53-47df-9d72-01a8885c004f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:49.236755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052424f-ef53-47df-9d72-01a8885c004f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-6052424f-ef53-47df-9d72-01a8885c004f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:10:49.244542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:49.245553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:49.246480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 601/1235] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 10:10:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:49.252446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386faa4-d3ae-4909-b0b3-ca634f62ebd9 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:49.306454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:49.377710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386faa4-d3ae-4909-b0b3-ca634f62ebd9 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:49.415081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd82a-9c16-4d2a-b33d-e2eacad94056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:49.415756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd82a-9c16-4d2a-b33d-e2eacad94056 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:49.416067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd82a-9c16-4d2a-b33d-e2eacad94056 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:49.416338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd82a-9c16-4d2a-b33d-e2eacad94056 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:49.417077 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdd82a-9c16-4d2a-b33d-e2eacad94056 None admin] RBAC: Adding query filter params (name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:49.417381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdd82a-9c16-4d2a-b33d-e2eacad94056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:49.418782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdd82a-9c16-4d2a-b33d-e2eacad94056 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:49.428226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 635/1236] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 10:10:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:49.434242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052424f-ef53-47df-9d72-01a8885c004f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:49.530825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:49.552589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052424f-ef53-47df-9d72-01a8885c004f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:49.592358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d24ad-12a1-46b2-bebd-2e169653f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:49.593158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d24ad-12a1-46b2-bebd-2e169653f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:49.593453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d24ad-12a1-46b2-bebd-2e169653f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:49.593728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d24ad-12a1-46b2-bebd-2e169653f2f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:49.607261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d24ad-12a1-46b2-bebd-2e169653f2f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:49.609231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d24ad-12a1-46b2-bebd-2e169653f2f0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-094d24ad-12a1-46b2-bebd-2e169653f2f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:49.629363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:49.630426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:49.631430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:49.631430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:49.631430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:49.631430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:49.631430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 602/1237] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:10:49.636827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd82a-9c16-4d2a-b33d-e2eacad94056 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:49.758337 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd82a-9c16-4d2a-b33d-e2eacad94056 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:49.771891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:49.803848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e4d61-9399-4db5-83df-e8c7391abb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:49.804724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e4d61-9399-4db5-83df-e8c7391abb09 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:49.805119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e4d61-9399-4db5-83df-e8c7391abb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:49.805406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e4d61-9399-4db5-83df-e8c7391abb09 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:49.806310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e4d61-9399-4db5-83df-e8c7391abb09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:49.806965 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e4d61-9399-4db5-83df-e8c7391abb09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:49.808720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e4d61-9399-4db5-83df-e8c7391abb09 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:49.822215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 636/1238] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:49.829010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d24ad-12a1-46b2-bebd-2e169653f2f0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:49.956318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d24ad-12a1-46b2-bebd-2e169653f2f0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:50.001313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1000-20a5-4232-a074-ca609a7ef14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:50.002173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1000-20a5-4232-a074-ca609a7ef14b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:50.002456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1000-20a5-4232-a074-ca609a7ef14b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:50.002754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1000-20a5-4232-a074-ca609a7ef14b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:50.006052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:50.014219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e1000-20a5-4232-a074-ca609a7ef14b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:50.015943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e1000-20a5-4232-a074-ca609a7ef14b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3a5e1000-20a5-4232-a074-ca609a7ef14b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:10:50.033533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:50.039706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:50.040909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 603/1239] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:10:50.041650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e4d61-9399-4db5-83df-e8c7391abb09 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:50.146239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e4d61-9399-4db5-83df-e8c7391abb09 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:50.181558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e900f-a82b-4610-bcef-db96cfd0d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:50.182253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e900f-a82b-4610-bcef-db96cfd0d428 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:50.182561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e900f-a82b-4610-bcef-db96cfd0d428 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:50.182832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e900f-a82b-4610-bcef-db96cfd0d428 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:50.183724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e900f-a82b-4610-bcef-db96cfd0d428 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:50.184029 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e900f-a82b-4610-bcef-db96cfd0d428 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:50.185463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e900f-a82b-4610-bcef-db96cfd0d428 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:50.203797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 637/1240] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 10:10:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:50.209976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1000-20a5-4232-a074-ca609a7ef14b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:50.332626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1000-20a5-4232-a074-ca609a7ef14b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:50.373883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fef85-7233-4e3b-943f-734f5dcef501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:50.374652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fef85-7233-4e3b-943f-734f5dcef501 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:50.374952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fef85-7233-4e3b-943f-734f5dcef501 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:50.375288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fef85-7233-4e3b-943f-734f5dcef501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:50.446207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:50.453819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fef85-7233-4e3b-943f-734f5dcef501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:50.455330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fef85-7233-4e3b-943f-734f5dcef501 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:50.567828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 604/1241] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:10:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:10:50.574422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e900f-a82b-4610-bcef-db96cfd0d428 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:50.605490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:50.689269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e900f-a82b-4610-bcef-db96cfd0d428 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:50.727816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504a448-b56a-41b4-8402-7079ebea964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:50.728663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504a448-b56a-41b4-8402-7079ebea964e None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:50.728968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504a448-b56a-41b4-8402-7079ebea964e None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:50.729322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504a448-b56a-41b4-8402-7079ebea964e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:50.741751 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504a448-b56a-41b4-8402-7079ebea964e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:50.743473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504a448-b56a-41b4-8402-7079ebea964e None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-f504a448-b56a-41b4-8402-7079ebea964e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:50.763818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:50.765035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:50.766487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:50.766487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:50.766487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:50.766487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:50.770299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 638/1242] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:50.771447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fef85-7233-4e3b-943f-734f5dcef501 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:50.875624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:50.882314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fef85-7233-4e3b-943f-734f5dcef501 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:50.920434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4e56-3151-4a87-8e10-9ea2587473cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:50.921104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4e56-3151-4a87-8e10-9ea2587473cc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:50.921385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4e56-3151-4a87-8e10-9ea2587473cc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:50.921654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4e56-3151-4a87-8e10-9ea2587473cc None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:50.922380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d4e56-3151-4a87-8e10-9ea2587473cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:50.922714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d4e56-3151-4a87-8e10-9ea2587473cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:50.924109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d4e56-3151-4a87-8e10-9ea2587473cc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:50.936727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 605/1243] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:50.942695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504a448-b56a-41b4-8402-7079ebea964e None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:51.027924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:51.054495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504a448-b56a-41b4-8402-7079ebea964e None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:51.093230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ce41d-b1a7-406a-a8cf-8f14115cba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:51.094031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ce41d-b1a7-406a-a8cf-8f14115cba4d None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:51.094308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ce41d-b1a7-406a-a8cf-8f14115cba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:51.094610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ce41d-b1a7-406a-a8cf-8f14115cba4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:51.101884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ce41d-b1a7-406a-a8cf-8f14115cba4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:51.103382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ce41d-b1a7-406a-a8cf-8f14115cba4d None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-6e4ce41d-b1a7-406a-a8cf-8f14115cba4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:10:51.117554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:51.118783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:51.120047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:10:51.120047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:10:51.120047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:10:51.120047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:10:51.120047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:10:51.120047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:10:51.120047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:10:51.120047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:51.120047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 639/1244] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:10:51.125054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4e56-3151-4a87-8e10-9ea2587473cc None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:51.238326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4e56-3151-4a87-8e10-9ea2587473cc None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:51.275932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b06fa-fc56-433b-bd73-20f2503e6fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:51.276629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b06fa-fc56-433b-bd73-20f2503e6fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:51.276987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b06fa-fc56-433b-bd73-20f2503e6fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:51.277177 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b06fa-fc56-433b-bd73-20f2503e6fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:51.278018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b06fa-fc56-433b-bd73-20f2503e6fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:51.278269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b06fa-fc56-433b-bd73-20f2503e6fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:51.279872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b06fa-fc56-433b-bd73-20f2503e6fe9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:51.293941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 606/1245] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:51.300347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ce41d-b1a7-406a-a8cf-8f14115cba4d None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:51.417275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ce41d-b1a7-406a-a8cf-8f14115cba4d None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:51.457352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1c1e6-6fbf-4ebf-ae61-80382b1d78ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:51.458081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c1e6-6fbf-4ebf-ae61-80382b1d78ef None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:51.458365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c1e6-6fbf-4ebf-ae61-80382b1d78ef None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:51.458679 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c1e6-6fbf-4ebf-ae61-80382b1d78ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:51.459554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1c1e6-6fbf-4ebf-ae61-80382b1d78ef None admin] RBAC: Adding query filter params (role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=9b257dee0ca3400f860ef9bd8c7a4e4b) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:51.459871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1c1e6-6fbf-4ebf-ae61-80382b1d78ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:51.461410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1c1e6-6fbf-4ebf-ae61-80382b1d78ef None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:51.468654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 640/1246] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:10:51 2022] GET /identity/v3/role_assignments?user.id=9b257dee0ca3400f860ef9bd8c7a4e4b&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=111ab6c88aad4c2b96cc3d7ada1e2dc3 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:10:53.610416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4c84-339c-44de-970b-629a130a2be5 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:53.611006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4c84-339c-44de-970b-629a130a2be5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:53.611175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4c84-339c-44de-970b-629a130a2be5 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:53.612982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 607/1247] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:53.619215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35784bac-5c13-40c5-8239-3fcd42f676ca None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:53.619779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35784bac-5c13-40c5-8239-3fcd42f676ca None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:53.619779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35784bac-5c13-40c5-8239-3fcd42f676ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:53.625161 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:53.641370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-35784bac-5c13-40c5-8239-3fcd42f676ca None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:53.642849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-35784bac-5c13-40c5-8239-3fcd42f676ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:53.725465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 641/1248] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:10:53.749725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee4c84-339c-44de-970b-629a130a2be5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:53.771046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:53.862956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee4c84-339c-44de-970b-629a130a2be5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:53.900173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84a1ff-33fb-4e23-8085-91e4fa889261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:53.900968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84a1ff-33fb-4e23-8085-91e4fa889261 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:53.901251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84a1ff-33fb-4e23-8085-91e4fa889261 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:53.901562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84a1ff-33fb-4e23-8085-91e4fa889261 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:53.912642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84a1ff-33fb-4e23-8085-91e4fa889261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8e84a1ff-33fb-4e23-8085-91e4fa889261 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:10:53.921426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:53.922625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:53.923587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 608/1249] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:53.929285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35784bac-5c13-40c5-8239-3fcd42f676ca None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:54.045546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35784bac-5c13-40c5-8239-3fcd42f676ca None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:54.084112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:54.089746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b17ed-ad24-4152-869f-1c69bcf694d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:54.090462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b17ed-ad24-4152-869f-1c69bcf694d6 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:54.090775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b17ed-ad24-4152-869f-1c69bcf694d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:54.091053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b17ed-ad24-4152-869f-1c69bcf694d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:54.091832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b17ed-ad24-4152-869f-1c69bcf694d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:54.092113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b17ed-ad24-4152-869f-1c69bcf694d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:54.093564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b17ed-ad24-4152-869f-1c69bcf694d6 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:54.104514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 642/1250] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:10:54.111894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84a1ff-33fb-4e23-8085-91e4fa889261 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:54.197011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:54.227233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84a1ff-33fb-4e23-8085-91e4fa889261 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:54.265291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d853-f4fb-466b-861e-a24b9fd714c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:54.266088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d853-f4fb-466b-861e-a24b9fd714c7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:54.266367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d853-f4fb-466b-861e-a24b9fd714c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:54.266678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d853-f4fb-466b-861e-a24b9fd714c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:54.278339 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d853-f4fb-466b-861e-a24b9fd714c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:54.279816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d853-f4fb-466b-861e-a24b9fd714c7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a025d853-f4fb-466b-861e-a24b9fd714c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:54.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:54.301135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:54.307192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:54.307192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:54.307192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:54.307192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:54.307192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 609/1251] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:54.307569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b17ed-ad24-4152-869f-1c69bcf694d6 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:54.435985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b17ed-ad24-4152-869f-1c69bcf694d6 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:54.476643 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b18e-e6cb-4239-bc14-74f6d5505455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:54.477643 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b18e-e6cb-4239-bc14-74f6d5505455 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:54.477920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b18e-e6cb-4239-bc14-74f6d5505455 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:54.478258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b18e-e6cb-4239-bc14-74f6d5505455 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:54.479075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b18e-e6cb-4239-bc14-74f6d5505455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:54.479384 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b18e-e6cb-4239-bc14-74f6d5505455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:54.480901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b18e-e6cb-4239-bc14-74f6d5505455 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:54.494158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 643/1252] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:54.499893 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d853-f4fb-466b-861e-a24b9fd714c7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:54.612303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d853-f4fb-466b-861e-a24b9fd714c7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:54.647448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:54.656154 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892156e-e4ad-475b-add6-0040bdcdf220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:54.657292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892156e-e4ad-475b-add6-0040bdcdf220 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:54.657581 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892156e-e4ad-475b-add6-0040bdcdf220 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:54.657847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892156e-e4ad-475b-add6-0040bdcdf220 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:54.667029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892156e-e4ad-475b-add6-0040bdcdf220 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:54.668462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892156e-e4ad-475b-add6-0040bdcdf220 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-9892156e-e4ad-475b-add6-0040bdcdf220 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:10:54.683442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:54.684616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:54.685672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 610/1253] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:54.690710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b18e-e6cb-4239-bc14-74f6d5505455 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:54.760048 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:54.810958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b18e-e6cb-4239-bc14-74f6d5505455 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:54.850523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d436035-2233-40f1-9e49-86d71f416f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:54.851304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d436035-2233-40f1-9e49-86d71f416f50 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:54.851573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d436035-2233-40f1-9e49-86d71f416f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:54.851843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d436035-2233-40f1-9e49-86d71f416f50 None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:54.852783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d436035-2233-40f1-9e49-86d71f416f50 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:54.853108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d436035-2233-40f1-9e49-86d71f416f50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:54.854692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d436035-2233-40f1-9e49-86d71f416f50 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:54.879399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 644/1254] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 10:10:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:54.884477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892156e-e4ad-475b-add6-0040bdcdf220 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:55.004916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892156e-e4ad-475b-add6-0040bdcdf220 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:55.047080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a48e9c-fdc6-4c8f-8ce8-0dcdf9ac0a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:55.047771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48e9c-fdc6-4c8f-8ce8-0dcdf9ac0a93 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:55.048146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48e9c-fdc6-4c8f-8ce8-0dcdf9ac0a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:55.048474 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48e9c-fdc6-4c8f-8ce8-0dcdf9ac0a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:55.113985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:55.129054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a48e9c-fdc6-4c8f-8ce8-0dcdf9ac0a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:55.130665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a48e9c-fdc6-4c8f-8ce8-0dcdf9ac0a93 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:55.246533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 611/1255] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:10:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 10:10:55.252760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d436035-2233-40f1-9e49-86d71f416f50 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:55.386637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d436035-2233-40f1-9e49-86d71f416f50 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:55.401752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:55.424422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0945480-ebc8-4d4b-9dbc-ab32d35d8c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:55.425250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0945480-ebc8-4d4b-9dbc-ab32d35d8c7c None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:55.425528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0945480-ebc8-4d4b-9dbc-ab32d35d8c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:55.425848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0945480-ebc8-4d4b-9dbc-ab32d35d8c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:55.436465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0945480-ebc8-4d4b-9dbc-ab32d35d8c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:55.437975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0945480-ebc8-4d4b-9dbc-ab32d35d8c7c None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-e0945480-ebc8-4d4b-9dbc-ab32d35d8c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:55.455929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:55.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:55.458417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:55.458417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:55.458417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:55.458417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:55.458417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 645/1256] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:55.464865 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a48e9c-fdc6-4c8f-8ce8-0dcdf9ac0a93 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:55.576895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:55.590243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a48e9c-fdc6-4c8f-8ce8-0dcdf9ac0a93 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:55.625630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9d569-3c9c-4301-aa1e-41d38b5f2f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:55.626304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d569-3c9c-4301-aa1e-41d38b5f2f1f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:55.626609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d569-3c9c-4301-aa1e-41d38b5f2f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:55.626884 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d569-3c9c-4301-aa1e-41d38b5f2f1f None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:55.627612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9d569-3c9c-4301-aa1e-41d38b5f2f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:55.627909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9d569-3c9c-4301-aa1e-41d38b5f2f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:55.629313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9d569-3c9c-4301-aa1e-41d38b5f2f1f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:55.646079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 612/1257] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:55.647297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0945480-ebc8-4d4b-9dbc-ab32d35d8c7c None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:55.765202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0945480-ebc8-4d4b-9dbc-ab32d35d8c7c None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:55.803647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe67a7-a72c-4701-8027-58e45b0651bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:55.804483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe67a7-a72c-4701-8027-58e45b0651bb None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:55.804774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe67a7-a72c-4701-8027-58e45b0651bb None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:55.805045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe67a7-a72c-4701-8027-58e45b0651bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:55.814663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe67a7-a72c-4701-8027-58e45b0651bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:55.816194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe67a7-a72c-4701-8027-58e45b0651bb None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-0cfe67a7-a72c-4701-8027-58e45b0651bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:10:55.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:55.831441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:55.832711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:10:55.832711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:10:55.832711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:10:55.832711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:10:55.832711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:10:55.832711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:10:55.832711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:10:55.832711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:10:55.832711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 646/1258] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:55.837152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9d569-3c9c-4301-aa1e-41d38b5f2f1f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:55.956403 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9d569-3c9c-4301-aa1e-41d38b5f2f1f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:55.993008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16e262-c536-4c70-bbb7-908824dc6bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:55.994104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e262-c536-4c70-bbb7-908824dc6bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:55.994517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e262-c536-4c70-bbb7-908824dc6bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:55.995027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e262-c536-4c70-bbb7-908824dc6bf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:55.996099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16e262-c536-4c70-bbb7-908824dc6bf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:55.996421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16e262-c536-4c70-bbb7-908824dc6bf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:55.998188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16e262-c536-4c70-bbb7-908824dc6bf6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:56.013692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 613/1259] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:10:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:56.020312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe67a7-a72c-4701-8027-58e45b0651bb None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:56.049570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:56.127871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe67a7-a72c-4701-8027-58e45b0651bb None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:56.165175 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c02bc-e919-46f9-b5de-207386dbd8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:56.165907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c02bc-e919-46f9-b5de-207386dbd8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:56.166232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c02bc-e919-46f9-b5de-207386dbd8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:56.166436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c02bc-e919-46f9-b5de-207386dbd8d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:56.167295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c02bc-e919-46f9-b5de-207386dbd8d9 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=9b257dee0ca3400f860ef9bd8c7a4e4b) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:56.167652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c02bc-e919-46f9-b5de-207386dbd8d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:56.169184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c02bc-e919-46f9-b5de-207386dbd8d9 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:56.175355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 647/1260] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:10:56 2022] GET /identity/v3/role_assignments?user.id=9b257dee0ca3400f860ef9bd8c7a4e4b&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:58.225037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e02af3-d0d5-4a52-abdb-394aa30a61e3 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:58.225913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e02af3-d0d5-4a52-abdb-394aa30a61e3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:58.225913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e02af3-d0d5-4a52-abdb-394aa30a61e3 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:58.227496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 614/1261] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:10:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:58.232709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00bc68-a1d6-4837-a54f-b86b158c3774 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:58.233125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00bc68-a1d6-4837-a54f-b86b158c3774 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:58.233239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00bc68-a1d6-4837-a54f-b86b158c3774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:58.251601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-3c00bc68-a1d6-4837-a54f-b86b158c3774 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:58.252801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3c00bc68-a1d6-4837-a54f-b86b158c3774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:58.331145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 648/1262] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:10:58.357200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e02af3-d0d5-4a52-abdb-394aa30a61e3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:58.370712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:58.472777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e02af3-d0d5-4a52-abdb-394aa30a61e3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:58.508916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323739f-efb2-401b-ace7-15ceef2b6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:58.509631 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323739f-efb2-401b-ace7-15ceef2b6648 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:58.509914 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323739f-efb2-401b-ace7-15ceef2b6648 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:58.510181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323739f-efb2-401b-ace7-15ceef2b6648 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:58.521154 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323739f-efb2-401b-ace7-15ceef2b6648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-c323739f-efb2-401b-ace7-15ceef2b6648 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:10:58.528840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:58.529924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:58.530990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 615/1263] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:58.538676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00bc68-a1d6-4837-a54f-b86b158c3774 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:58.558355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:58.655708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00bc68-a1d6-4837-a54f-b86b158c3774 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:58.694079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbd9f2-1e44-4466-82c8-d42d8ba12888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:58.694840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbd9f2-1e44-4466-82c8-d42d8ba12888 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:58.695126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbd9f2-1e44-4466-82c8-d42d8ba12888 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:58.695404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbd9f2-1e44-4466-82c8-d42d8ba12888 None admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:58.696186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbd9f2-1e44-4466-82c8-d42d8ba12888 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:58.696503 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbd9f2-1e44-4466-82c8-d42d8ba12888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:58.697884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbd9f2-1e44-4466-82c8-d42d8ba12888 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:58.707426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 649/1264] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:58.713478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323739f-efb2-401b-ace7-15ceef2b6648 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:58.781748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:58.828768 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323739f-efb2-401b-ace7-15ceef2b6648 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:58.867409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1a812-9864-4b20-9316-98933bd243e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:58.868203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1a812-9864-4b20-9316-98933bd243e8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:58.868486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1a812-9864-4b20-9316-98933bd243e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:58.868755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1a812-9864-4b20-9316-98933bd243e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:58.879806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1a812-9864-4b20-9316-98933bd243e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:58.881279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1a812-9864-4b20-9316-98933bd243e8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-93e1a812-9864-4b20-9316-98933bd243e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:58.899905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:58.900972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:58.902018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:58.902018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:58.902018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:58.902018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:58.902018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 616/1265] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:58.907713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbd9f2-1e44-4466-82c8-d42d8ba12888 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:58.993443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:59.024494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbd9f2-1e44-4466-82c8-d42d8ba12888 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:59.078357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213af8e2-94fd-437e-bc2d-03cfb829d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:59.078969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213af8e2-94fd-437e-bc2d-03cfb829d588 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:59.079249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213af8e2-94fd-437e-bc2d-03cfb829d588 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:59.079519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213af8e2-94fd-437e-bc2d-03cfb829d588 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:59.080277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213af8e2-94fd-437e-bc2d-03cfb829d588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:59.080582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213af8e2-94fd-437e-bc2d-03cfb829d588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:59.081963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213af8e2-94fd-437e-bc2d-03cfb829d588 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:59.094945 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 650/1266] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:59.103959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1a812-9864-4b20-9316-98933bd243e8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:59.219206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1a812-9864-4b20-9316-98933bd243e8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:59.241934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:59.265279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db9cc4-c0a4-4ce8-93f6-a660e1edbb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:59.266549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db9cc4-c0a4-4ce8-93f6-a660e1edbb55 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:59.267117 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db9cc4-c0a4-4ce8-93f6-a660e1edbb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:59.267513 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db9cc4-c0a4-4ce8-93f6-a660e1edbb55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:59.277368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db9cc4-c0a4-4ce8-93f6-a660e1edbb55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:59.278835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db9cc4-c0a4-4ce8-93f6-a660e1edbb55 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-25db9cc4-c0a4-4ce8-93f6-a660e1edbb55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:10:59.293686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:59.294838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:59.295825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 617/1267] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:59.300929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213af8e2-94fd-437e-bc2d-03cfb829d588 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:59.415868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213af8e2-94fd-437e-bc2d-03cfb829d588 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:59.454058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6263b9-287d-4f24-888b-f0dd17b1162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:59.454778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6263b9-287d-4f24-888b-f0dd17b1162f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:59.455063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6263b9-287d-4f24-888b-f0dd17b1162f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:59.455341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6263b9-287d-4f24-888b-f0dd17b1162f None admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:59.456211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6263b9-287d-4f24-888b-f0dd17b1162f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:59.456525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6263b9-287d-4f24-888b-f0dd17b1162f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:59.457964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6263b9-287d-4f24-888b-f0dd17b1162f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:59.466842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:59.476513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 651/1268] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 10:10:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:59.482375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db9cc4-c0a4-4ce8-93f6-a660e1edbb55 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:59.586081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db9cc4-c0a4-4ce8-93f6-a660e1edbb55 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:59.625478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57de2f-8c46-454c-b5b1-db8857761a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:59.626286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57de2f-8c46-454c-b5b1-db8857761a71 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:59.626580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57de2f-8c46-454c-b5b1-db8857761a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:59.626897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57de2f-8c46-454c-b5b1-db8857761a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:59.637655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57de2f-8c46-454c-b5b1-db8857761a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:59.639254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57de2f-8c46-454c-b5b1-db8857761a71 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-fe57de2f-8c46-454c-b5b1-db8857761a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:10:59.656621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:10:59.658033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:10:59.659197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:10:59.659197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:10:59.659197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:10:59.659197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:10:59.659197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 618/1269] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:10:59.663928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6263b9-287d-4f24-888b-f0dd17b1162f None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:59.772766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6263b9-287d-4f24-888b-f0dd17b1162f None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:59.808232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3b187-e06a-433f-b53b-3577a62817d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:59.808889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3b187-e06a-433f-b53b-3577a62817d1 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:59.809172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3b187-e06a-433f-b53b-3577a62817d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:59.809445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3b187-e06a-433f-b53b-3577a62817d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:59.810171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3b187-e06a-433f-b53b-3577a62817d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:10:59.810476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3b187-e06a-433f-b53b-3577a62817d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:59.811887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3b187-e06a-433f-b53b-3577a62817d1 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:59.823440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 652/1270] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:10:59.829931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57de2f-8c46-454c-b5b1-db8857761a71 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:59.863598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:59.944856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57de2f-8c46-454c-b5b1-db8857761a71 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:59.980167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227d4fa-aed9-4ce5-91f0-907dd95e6a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:59.980948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227d4fa-aed9-4ce5-91f0-907dd95e6a44 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:59.981228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227d4fa-aed9-4ce5-91f0-907dd95e6a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:59.981497 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227d4fa-aed9-4ce5-91f0-907dd95e6a44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:59.988775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227d4fa-aed9-4ce5-91f0-907dd95e6a44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:59.990228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227d4fa-aed9-4ce5-91f0-907dd95e6a44 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-f227d4fa-aed9-4ce5-91f0-907dd95e6a44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:11:00.005332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:11:00.006350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:11:00.007600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:11:00.007600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:11:00.007600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:11:00.007600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:11:00.007600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:11:00.007600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:11:00.007600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:11:00.007600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:11:00.007600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 619/1271] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:11:00.013385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3b187-e06a-433f-b53b-3577a62817d1 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:00.080604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:00.131171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3b187-e06a-433f-b53b-3577a62817d1 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:00.169345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5579b-acef-4f71-af8d-d7734c166fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:00.170031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5579b-acef-4f71-af8d-d7734c166fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:00.170313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5579b-acef-4f71-af8d-d7734c166fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:00.170623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5579b-acef-4f71-af8d-d7734c166fe8 None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:00.171436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5579b-acef-4f71-af8d-d7734c166fe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:00.171750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5579b-acef-4f71-af8d-d7734c166fe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:00.173204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5579b-acef-4f71-af8d-d7734c166fe8 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:00.185410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 653/1272] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:00.191550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227d4fa-aed9-4ce5-91f0-907dd95e6a44 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:00.287198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:00.301861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227d4fa-aed9-4ce5-91f0-907dd95e6a44 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:00.349253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091988b-b014-4a11-8f5a-bfb586367773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:00.350308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091988b-b014-4a11-8f5a-bfb586367773 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:00.350641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091988b-b014-4a11-8f5a-bfb586367773 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:00.351007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091988b-b014-4a11-8f5a-bfb586367773 None admin] PATH_INFO: `/v3/projects/53153b511330427b9325ae63396dd6f5/users/9b257dee0ca3400f860ef9bd8c7a4e4b/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:00.353329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091988b-b014-4a11-8f5a-bfb586367773 None admin] RBAC: Authorizing `identity:create_grant(project_id=53153b511330427b9325ae63396dd6f5, user_id=9b257dee0ca3400f860ef9bd8c7a4e4b, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:00.354975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091988b-b014-4a11-8f5a-bfb586367773 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:00.369505 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 620/1273] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 10:11:00 2022] PUT /identity/v3/projects/53153b511330427b9325ae63396dd6f5/users/9b257dee0ca3400f860ef9bd8c7a4e4b/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:11:02.389289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223099-b2aa-4077-bc32-ef4cc3d7dd75 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:02.390311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223099-b2aa-4077-bc32-ef4cc3d7dd75 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:02.390827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223099-b2aa-4077-bc32-ef4cc3d7dd75 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:02.394107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 654/1274] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:11:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:02.399735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e057-24d1-4ff7-b015-efacfda97237 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:02.400334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e057-24d1-4ff7-b015-efacfda97237 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:02.400334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e057-24d1-4ff7-b015-efacfda97237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:02.428065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-cbf6e057-24d1-4ff7-b015-efacfda97237 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:02.429669 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cbf6e057-24d1-4ff7-b015-efacfda97237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:02.499484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 621/1275] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:11:02.525906 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223099-b2aa-4077-bc32-ef4cc3d7dd75 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:02.653837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223099-b2aa-4077-bc32-ef4cc3d7dd75 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:02.671758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:02.689326 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022c9b-9e52-4b41-a624-0bb1c71edf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:02.690129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022c9b-9e52-4b41-a624-0bb1c71edf04 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:02.690414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022c9b-9e52-4b41-a624-0bb1c71edf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:02.690723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022c9b-9e52-4b41-a624-0bb1c71edf04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:02.700979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0022c9b-9e52-4b41-a624-0bb1c71edf04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-d0022c9b-9e52-4b41-a624-0bb1c71edf04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:11:02.708611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:11:02.709720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:02.710834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 655/1276] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 10:11:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:11:02.716280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6e057-24d1-4ff7-b015-efacfda97237 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:02.802207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:02.822383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6e057-24d1-4ff7-b015-efacfda97237 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:02.859661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b664232-9854-4982-a198-8466dddf7eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:02.860635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b664232-9854-4982-a198-8466dddf7eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:02.861026 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b664232-9854-4982-a198-8466dddf7eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:02.861397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b664232-9854-4982-a198-8466dddf7eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:02.862488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b664232-9854-4982-a198-8466dddf7eb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:02.862938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b664232-9854-4982-a198-8466dddf7eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:02.865077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b664232-9854-4982-a198-8466dddf7eb5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:02.874375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 622/1277] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 10:11:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:11:02.880437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022c9b-9e52-4b41-a624-0bb1c71edf04 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:02.991218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022c9b-9e52-4b41-a624-0bb1c71edf04 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:03.024364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5ec40-6138-4560-a810-25bc0cc38530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:03.025152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5ec40-6138-4560-a810-25bc0cc38530 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:03.025434 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5ec40-6138-4560-a810-25bc0cc38530 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:03.025711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5ec40-6138-4560-a810-25bc0cc38530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:03.036568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5ec40-6138-4560-a810-25bc0cc38530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:03.038023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5ec40-6138-4560-a810-25bc0cc38530 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-cbf5ec40-6138-4560-a810-25bc0cc38530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:11:03.057363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:11:03.058449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:11:03.060026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:11:03.060026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:11:03.060026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:11:03.060026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:03.060026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 656/1278] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:11:03.068145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b664232-9854-4982-a198-8466dddf7eb5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:03.185092 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b664232-9854-4982-a198-8466dddf7eb5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:03.219689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a968b-2d12-48eb-8878-9646350a768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:03.220353 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a968b-2d12-48eb-8878-9646350a768e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:03.220634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a968b-2d12-48eb-8878-9646350a768e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:03.220912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a968b-2d12-48eb-8878-9646350a768e None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:03.221635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a968b-2d12-48eb-8878-9646350a768e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:03.221947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a968b-2d12-48eb-8878-9646350a768e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:03.223356 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a968b-2d12-48eb-8878-9646350a768e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:03.235453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 623/1279] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:03.241940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5ec40-6138-4560-a810-25bc0cc38530 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:03.273320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:03.364202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5ec40-6138-4560-a810-25bc0cc38530 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:03.408136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bacde-8107-467b-a252-3f65220b5e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:03.409370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bacde-8107-467b-a252-3f65220b5e70 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:03.410345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bacde-8107-467b-a252-3f65220b5e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:03.410816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bacde-8107-467b-a252-3f65220b5e70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:03.421459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bacde-8107-467b-a252-3f65220b5e70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:03.422980 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bacde-8107-467b-a252-3f65220b5e70 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-315bacde-8107-467b-a252-3f65220b5e70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:11:03.437243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:11:03.438336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:03.439390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 657/1280] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:11:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:11:03.444825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a968b-2d12-48eb-8878-9646350a768e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:03.449129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:03.553121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a968b-2d12-48eb-8878-9646350a768e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:03.600190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214e9f9-0658-4187-bdaa-430b017e6057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:03.600952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e9f9-0658-4187-bdaa-430b017e6057 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:03.601232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e9f9-0658-4187-bdaa-430b017e6057 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:03.601512 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e9f9-0658-4187-bdaa-430b017e6057 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:03.602367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214e9f9-0658-4187-bdaa-430b017e6057 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:03.602701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214e9f9-0658-4187-bdaa-430b017e6057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:03.604197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214e9f9-0658-4187-bdaa-430b017e6057 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:03.624912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 624/1281] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 10:11:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:03.631828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bacde-8107-467b-a252-3f65220b5e70 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:03.736275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:03.746711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bacde-8107-467b-a252-3f65220b5e70 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:03.781378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685c96-c3fa-4a48-b61c-8c26ad8e1743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:03.782397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685c96-c3fa-4a48-b61c-8c26ad8e1743 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:03.782718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685c96-c3fa-4a48-b61c-8c26ad8e1743 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:03.782999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685c96-c3fa-4a48-b61c-8c26ad8e1743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:03.854005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11685c96-c3fa-4a48-b61c-8c26ad8e1743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:03.855451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11685c96-c3fa-4a48-b61c-8c26ad8e1743 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:03.949090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:03.962061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 658/1282] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 10:11:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:03.973287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214e9f9-0658-4187-bdaa-430b017e6057 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:04.040145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:04.079534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214e9f9-0658-4187-bdaa-430b017e6057 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:04.116080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c55dc-ebe1-4166-acab-df6e24d8d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:04.116913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c55dc-ebe1-4166-acab-df6e24d8d42f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:04.117189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c55dc-ebe1-4166-acab-df6e24d8d42f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:04.117457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c55dc-ebe1-4166-acab-df6e24d8d42f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:04.128425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c55dc-ebe1-4166-acab-df6e24d8d42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:04.129906 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c55dc-ebe1-4166-acab-df6e24d8d42f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-6a5c55dc-ebe1-4166-acab-df6e24d8d42f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:11:04.147348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:11:04.148471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:11:04.149472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:11:04.149472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:11:04.149472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:11:04.149472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:11:04.149472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 625/1283] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:11:04.155391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685c96-c3fa-4a48-b61c-8c26ad8e1743 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:04.270706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685c96-c3fa-4a48-b61c-8c26ad8e1743 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:04.307844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb564f9-8b47-4687-a0f8-541692d75779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:04.308501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb564f9-8b47-4687-a0f8-541692d75779 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:04.308768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb564f9-8b47-4687-a0f8-541692d75779 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:04.309046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb564f9-8b47-4687-a0f8-541692d75779 None admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:04.309775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb564f9-8b47-4687-a0f8-541692d75779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:04.310103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb564f9-8b47-4687-a0f8-541692d75779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:04.311510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb564f9-8b47-4687-a0f8-541692d75779 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:04.324747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 659/1284] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 10:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:04.332777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c55dc-ebe1-4166-acab-df6e24d8d42f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:04.440588 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c55dc-ebe1-4166-acab-df6e24d8d42f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:04.454740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:04.476092 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0d5a1-9cdb-4d57-8b0b-c14f47837ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:04.476896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d5a1-9cdb-4d57-8b0b-c14f47837ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:04.477184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d5a1-9cdb-4d57-8b0b-c14f47837ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:04.477457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d5a1-9cdb-4d57-8b0b-c14f47837ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:04.484832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0d5a1-9cdb-4d57-8b0b-c14f47837ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:04.486305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0d5a1-9cdb-4d57-8b0b-c14f47837ca0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-2fb0d5a1-9cdb-4d57-8b0b-c14f47837ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:11:04.500656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:11:04.501717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:11:04.503089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:11:04.503089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:11:04.503089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:11:04.503089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:11:04.503089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:11:04.503089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:11:04.503089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:11:04.503089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 22 10:11:04.503089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 626/1285] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 10:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:11:04.509960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb564f9-8b47-4687-a0f8-541692d75779 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:04.572817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:04.627276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb564f9-8b47-4687-a0f8-541692d75779 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:04.664439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2dccb4-7051-4681-9dca-00095743129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:04.665122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dccb4-7051-4681-9dca-00095743129f None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:04.665409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dccb4-7051-4681-9dca-00095743129f None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:04.665690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dccb4-7051-4681-9dca-00095743129f None admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:04.666539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2dccb4-7051-4681-9dca-00095743129f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:04.666860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2dccb4-7051-4681-9dca-00095743129f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:04.668302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2dccb4-7051-4681-9dca-00095743129f None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:04.681040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 660/1286] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 10:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:11:04.687444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0d5a1-9cdb-4d57-8b0b-c14f47837ca0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:04.793059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0d5a1-9cdb-4d57-8b0b-c14f47837ca0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:04.831247 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839ddbe-d079-4d42-8dff-330275531944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:04.831909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839ddbe-d079-4d42-8dff-330275531944 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:04.832192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839ddbe-d079-4d42-8dff-330275531944 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:04.832490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839ddbe-d079-4d42-8dff-330275531944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:04.833368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839ddbe-d079-4d42-8dff-330275531944 None admin] RBAC: Adding query filter params (role.id=914e2b45c35049e3a9cf63a7b7a4414b, scope.project.id=53153b511330427b9325ae63396dd6f5, user.id=9b257dee0ca3400f860ef9bd8c7a4e4b) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:04.833677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839ddbe-d079-4d42-8dff-330275531944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:04.835204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839ddbe-d079-4d42-8dff-330275531944 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:04.842165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 627/1287] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 10:11:04 2022] GET /identity/v3/role_assignments?user.id=9b257dee0ca3400f860ef9bd8c7a4e4b&scope.project.id=53153b511330427b9325ae63396dd6f5&role.id=914e2b45c35049e3a9cf63a7b7a4414b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:06.900465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e76b3-e27f-42dd-8035-801a1c3f31c6 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:06.901016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e76b3-e27f-42dd-8035-801a1c3f31c6 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:06.901016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e76b3-e27f-42dd-8035-801a1c3f31c6 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:06.902319 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 661/1288] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:06.907978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1f8b9-f919-407e-9c26-0a3d71f63085 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:06.908421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1f8b9-f919-407e-9c26-0a3d71f63085 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:06.908556 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1f8b9-f919-407e-9c26-0a3d71f63085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:06.926220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7ed1f8b9-f919-407e-9c26-0a3d71f63085 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:06.927453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7ed1f8b9-f919-407e-9c26-0a3d71f63085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:06.958633 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:06.998790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 628/1289] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:11:07.022155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e76b3-e27f-42dd-8035-801a1c3f31c6 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:07.130043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e76b3-e27f-42dd-8035-801a1c3f31c6 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:07.142425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:07.168084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078f36f-e977-47ec-8d59-daa786ec5649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:07.168810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078f36f-e977-47ec-8d59-daa786ec5649 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:07.169098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078f36f-e977-47ec-8d59-daa786ec5649 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:07.169373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078f36f-e977-47ec-8d59-daa786ec5649 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:07.170032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078f36f-e977-47ec-8d59-daa786ec5649 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:07.171450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078f36f-e977-47ec-8d59-daa786ec5649 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-8078f36f-e977-47ec-8d59-daa786ec5649 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:11:07.183286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:11:07.184547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:07.185433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 662/1290] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 10:11:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:11:07.190664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1f8b9-f919-407e-9c26-0a3d71f63085 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:07.292561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1f8b9-f919-407e-9c26-0a3d71f63085 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:07.333379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd188f-747f-4cf1-ac99-b64e090b834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:07.334338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd188f-747f-4cf1-ac99-b64e090b834e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:07.334636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd188f-747f-4cf1-ac99-b64e090b834e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:07.334961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd188f-747f-4cf1-ac99-b64e090b834e None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:07.336101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd188f-747f-4cf1-ac99-b64e090b834e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:07.336418 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd188f-747f-4cf1-ac99-b64e090b834e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:07.338374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd188f-747f-4cf1-ac99-b64e090b834e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:07.345446 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 629/1291] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Jun 22 10:11:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:07.352058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078f36f-e977-47ec-8d59-daa786ec5649 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:07.471205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078f36f-e977-47ec-8d59-daa786ec5649 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:07.505245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612778db-5497-4db0-a039-3a14ee2d4e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:07.505903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612778db-5497-4db0-a039-3a14ee2d4e36 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:07.506194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612778db-5497-4db0-a039-3a14ee2d4e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:07.506475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612778db-5497-4db0-a039-3a14ee2d4e36 None admin] PATH_INFO: `/v3/services` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:07.507234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612778db-5497-4db0-a039-3a14ee2d4e36 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:07.507543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612778db-5497-4db0-a039-3a14ee2d4e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:07.508969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612778db-5497-4db0-a039-3a14ee2d4e36 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:07.513620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 663/1292] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Jun 22 10:11:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:09.500322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27028-5955-4e64-81ce-50e2bcc79a00 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:09.500883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27028-5955-4e64-81ce-50e2bcc79a00 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:09.500883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27028-5955-4e64-81ce-50e2bcc79a00 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:09.502227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 630/1293] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:09.507998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16d18f-4ccf-4876-97dd-1f53ef42f19c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:09.508412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16d18f-4ccf-4876-97dd-1f53ef42f19c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:09.508544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16d18f-4ccf-4876-97dd-1f53ef42f19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:09.526452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0a16d18f-4ccf-4876-97dd-1f53ef42f19c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:09.527665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0a16d18f-4ccf-4876-97dd-1f53ef42f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:09.561057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:09.602420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 664/1294] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:11:09.626841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f27028-5955-4e64-81ce-50e2bcc79a00 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:09.660948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:09.736489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f27028-5955-4e64-81ce-50e2bcc79a00 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:09.772400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409e698-6658-467a-964c-a92f1531d557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:09.773062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e698-6658-467a-964c-a92f1531d557 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:09.773346 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e698-6658-467a-964c-a92f1531d557 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:09.773623 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e698-6658-467a-964c-a92f1531d557 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:09.774352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409e698-6658-467a-964c-a92f1531d557 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:09.775764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409e698-6658-467a-964c-a92f1531d557 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:09.791488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 631/1295] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 10:11:09 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:11:11.830069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78531-36e7-40f1-b465-baac827f2adc None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:11.830673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78531-36e7-40f1-b465-baac827f2adc None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:11.830673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78531-36e7-40f1-b465-baac827f2adc None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:11.832047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 665/1296] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:11.837687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d5a39-d6d1-4a6a-a4e8-bd1abdc16ee9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:11.838163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d5a39-d6d1-4a6a-a4e8-bd1abdc16ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:11.838265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d5a39-d6d1-4a6a-a4e8-bd1abdc16ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:11.855948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fe6d5a39-d6d1-4a6a-a4e8-bd1abdc16ee9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:11.857246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fe6d5a39-d6d1-4a6a-a4e8-bd1abdc16ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:11.932111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 632/1297] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:11:11.955120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78531-36e7-40f1-b465-baac827f2adc None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:12.067720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78531-36e7-40f1-b465-baac827f2adc None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:12.105929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef120575-4067-49bc-865b-bc812f156fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:12.106779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef120575-4067-49bc-865b-bc812f156fce None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:12.107068 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef120575-4067-49bc-865b-bc812f156fce None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:12.107344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef120575-4067-49bc-865b-bc812f156fce None admin] PATH_INFO: `/v3/services/placement` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:12.108010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef120575-4067-49bc-865b-bc812f156fce None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:12.109429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef120575-4067-49bc-865b-bc812f156fce None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-ef120575-4067-49bc-865b-bc812f156fce None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:11:12.122336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:11:12.123497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:12.124526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 666/1298] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 10:11:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:11:12.130179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d5a39-d6d1-4a6a-a4e8-bd1abdc16ee9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:12.150134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:12.234321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d5a39-d6d1-4a6a-a4e8-bd1abdc16ee9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:12.269424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c640-cf5b-434c-9719-7ef9bc169990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:12.270082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c640-cf5b-434c-9719-7ef9bc169990 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:12.270365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c640-cf5b-434c-9719-7ef9bc169990 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:12.270663 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c640-cf5b-434c-9719-7ef9bc169990 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:12.271379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5c640-cf5b-434c-9719-7ef9bc169990 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:12.271683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5c640-cf5b-434c-9719-7ef9bc169990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:12.273165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5c640-cf5b-434c-9719-7ef9bc169990 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:12.278973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 633/1299] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Jun 22 10:11:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:12.285552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef120575-4067-49bc-865b-bc812f156fce None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:12.322470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:12.399078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef120575-4067-49bc-865b-bc812f156fce None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:12.433766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11e01f-d205-4130-9044-e5674f37c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:12.434416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11e01f-d205-4130-9044-e5674f37c1ee None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:12.434730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11e01f-d205-4130-9044-e5674f37c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:12.435008 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11e01f-d205-4130-9044-e5674f37c1ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:12.435799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11e01f-d205-4130-9044-e5674f37c1ee None admin] RBAC: Adding query filter params (interface=public, service_id=d5ad9f403d954a06adae9b8f3ed9d22f, region_id=RegionOne) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:12.436110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11e01f-d205-4130-9044-e5674f37c1ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:12.437505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11e01f-d205-4130-9044-e5674f37c1ee None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:12.442776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 667/1300] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 10:11:12 2022] GET /identity/v3/endpoints?service_id=d5ad9f403d954a06adae9b8f3ed9d22f&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:12.448747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c640-cf5b-434c-9719-7ef9bc169990 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:12.533645 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:12.553041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c640-cf5b-434c-9719-7ef9bc169990 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:12.588304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58116c0c-3dc4-4246-a4b0-7e3bdd1bc595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:12.588967 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116c0c-3dc4-4246-a4b0-7e3bdd1bc595 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:12.589256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116c0c-3dc4-4246-a4b0-7e3bdd1bc595 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:12.589531 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116c0c-3dc4-4246-a4b0-7e3bdd1bc595 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:12.590215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58116c0c-3dc4-4246-a4b0-7e3bdd1bc595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:12.591627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58116c0c-3dc4-4246-a4b0-7e3bdd1bc595 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:12.599193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 634/1301] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 10:11:12 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:11:14.633925 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252417-c270-4a42-bc22-3ffe5026b3f4 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:14.634547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252417-c270-4a42-bc22-3ffe5026b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:14.634547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252417-c270-4a42-bc22-3ffe5026b3f4 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:14.635945 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 668/1302] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:14.641293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f99c4-ce54-4068-ae66-008306aa4974 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:14.641805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f99c4-ce54-4068-ae66-008306aa4974 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:14.641898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f99c4-ce54-4068-ae66-008306aa4974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:14.659469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-120f99c4-ce54-4068-ae66-008306aa4974 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:14.660652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-120f99c4-ce54-4068-ae66-008306aa4974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:14.729701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 635/1303] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:11:14.753324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252417-c270-4a42-bc22-3ffe5026b3f4 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:14.852123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:14.859610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252417-c270-4a42-bc22-3ffe5026b3f4 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:14.894275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947d20d-7f1d-44f1-8df5-f52b4dcd80d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:14.895011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947d20d-7f1d-44f1-8df5-f52b4dcd80d6 None admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:14.895297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947d20d-7f1d-44f1-8df5-f52b4dcd80d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:14.895598 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947d20d-7f1d-44f1-8df5-f52b4dcd80d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:14.896254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947d20d-7f1d-44f1-8df5-f52b4dcd80d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:14.897755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947d20d-7f1d-44f1-8df5-f52b4dcd80d6 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application [None req-a947d20d-7f1d-44f1-8df5-f52b4dcd80d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:11:14.910126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:11:14.911332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application with Lock( Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: ERROR keystone.server.flask.application Jun 22 10:11:14.912235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 669/1304] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 10:11:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:11:14.917618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f99c4-ce54-4068-ae66-008306aa4974 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:14.996189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:15.021142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f99c4-ce54-4068-ae66-008306aa4974 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:15.056347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef13ea-401b-4847-8d6b-5c9a4c4130a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:15.056997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef13ea-401b-4847-8d6b-5c9a4c4130a3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:15.057275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef13ea-401b-4847-8d6b-5c9a4c4130a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:15.057543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef13ea-401b-4847-8d6b-5c9a4c4130a3 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:15.058245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef13ea-401b-4847-8d6b-5c9a4c4130a3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:15.058552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef13ea-401b-4847-8d6b-5c9a4c4130a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:15.059949 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef13ea-401b-4847-8d6b-5c9a4c4130a3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:15.065360 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 636/1305] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Jun 22 10:11:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:15.071512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947d20d-7f1d-44f1-8df5-f52b4dcd80d6 None admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:15.172804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947d20d-7f1d-44f1-8df5-f52b4dcd80d6 None admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:15.209975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291c13a-4d91-44d2-9de3-6f5b67bd1144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:15.210635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c13a-4d91-44d2-9de3-6f5b67bd1144 None admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:15.210934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c13a-4d91-44d2-9de3-6f5b67bd1144 None admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:15.211208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c13a-4d91-44d2-9de3-6f5b67bd1144 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:15.211948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291c13a-4d91-44d2-9de3-6f5b67bd1144 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:15.213350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291c13a-4d91-44d2-9de3-6f5b67bd1144 None admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:15.233018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 670/1306] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 10:11:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:11:25.062717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=30 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:25.228852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:20.549035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfa0c3-175c-44eb-a372-21e8b0687405 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:20.550130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfa0c3-175c-44eb-a372-21e8b0687405 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:20.550690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfa0c3-175c-44eb-a372-21e8b0687405 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:20.557894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72cc1c-9129-4991-aab6-7a9dd5d11360 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:20.558819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72cc1c-9129-4991-aab6-7a9dd5d11360 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:20.559311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72cc1c-9129-4991-aab6-7a9dd5d11360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:20.563073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 637/1307] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:20 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:20.649709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8d72cc1c-9129-4991-aab6-7a9dd5d11360 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:20.651369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8d72cc1c-9129-4991-aab6-7a9dd5d11360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:20.820409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 671/1308] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:12:20.859464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df649-5bb9-4c53-a74c-a2c9db337da7 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:20.859741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df649-5bb9-4c53-a74c-a2c9db337da7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:20.860006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df649-5bb9-4c53-a74c-a2c9db337da7 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:20.861698 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 638/1309] 10.222.0.66 () {54 vars in 964 bytes} [Wed Jun 22 10:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:20.871590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58d13-dbd1-4cf1-9316-bde8e22ca465 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:20.872027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58d13-dbd1-4cf1-9316-bde8e22ca465 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:20.872684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58d13-dbd1-4cf1-9316-bde8e22ca465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:20.986655 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-fbd58d13-dbd1-4cf1-9316-bde8e22ca465 None None] MFA Rules not processed for user `0afeafd76edb40289d715f81485fa7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:20.988293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-fbd58d13-dbd1-4cf1-9316-bde8e22ca465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:21.012247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:21.072442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 672/1310] 10.222.0.66 () {58 vars in 1061 bytes} [Wed Jun 22 10:12:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:21.082076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2df649-5bb9-4c53-a74c-a2c9db337da7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:21.084120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5c2df649-5bb9-4c53-a74c-a2c9db337da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:21.208556 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2df649-5bb9-4c53-a74c-a2c9db337da7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:21.288351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c84f-dd93-42b6-8cc9-26caaca3c6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:21.289354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c84f-dd93-42b6-8cc9-26caaca3c6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:21.289826 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c84f-dd93-42b6-8cc9-26caaca3c6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:21.290267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c84f-dd93-42b6-8cc9-26caaca3c6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:21.292160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9cd6c84f-dd93-42b6-8cc9-26caaca3c6b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:21.351538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:21.410226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c84f-dd93-42b6-8cc9-26caaca3c6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:21.411850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c84f-dd93-42b6-8cc9-26caaca3c6b1 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:21.434837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 639/1311] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:23.822263 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa538b-90bc-4c4b-9aef-c4b7f36a8de3 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:23.823298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa538b-90bc-4c4b-9aef-c4b7f36a8de3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:23.823298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa538b-90bc-4c4b-9aef-c4b7f36a8de3 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:23.824550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 673/1312] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:23.830602 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6160e39-4974-4a1c-9cd1-f5feffb107d0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:23.831222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6160e39-4974-4a1c-9cd1-f5feffb107d0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:23.831222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6160e39-4974-4a1c-9cd1-f5feffb107d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:23.926491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d6160e39-4974-4a1c-9cd1-f5feffb107d0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:23.927728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d6160e39-4974-4a1c-9cd1-f5feffb107d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:24.040789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 640/1313] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:24.078596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa538b-90bc-4c4b-9aef-c4b7f36a8de3 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:24.080142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-75aa538b-90bc-4c4b-9aef-c4b7f36a8de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:24.198009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa538b-90bc-4c4b-9aef-c4b7f36a8de3 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:24.285224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:24.288923 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670102df-4a92-449b-b511-222a37d2b645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:24.289832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670102df-4a92-449b-b511-222a37d2b645 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:24.290358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670102df-4a92-449b-b511-222a37d2b645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:24.290738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670102df-4a92-449b-b511-222a37d2b645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:24.292829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-670102df-4a92-449b-b511-222a37d2b645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:24.410470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670102df-4a92-449b-b511-222a37d2b645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:24.412366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670102df-4a92-449b-b511-222a37d2b645 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:24.432977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 674/1314] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:26.842843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c588ad-9a0e-4f6f-9573-eedd2c6c6fc0 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:26.843409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c588ad-9a0e-4f6f-9573-eedd2c6c6fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:26.843409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c588ad-9a0e-4f6f-9573-eedd2c6c6fc0 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:26.844779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 641/1315] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:26.850193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd61bfe-def6-4657-bd5f-5a0213cc2c29 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:26.850691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd61bfe-def6-4657-bd5f-5a0213cc2c29 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:26.850786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd61bfe-def6-4657-bd5f-5a0213cc2c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:26.919522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-1cd61bfe-def6-4657-bd5f-5a0213cc2c29 None None] MFA Rules not processed for user `6120ce90d3f04398b54f4c0245ad6ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:26.920668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1cd61bfe-def6-4657-bd5f-5a0213cc2c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:26.973349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:27.022295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 675/1316] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:27.062524 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c588ad-9a0e-4f6f-9573-eedd2c6c6fc0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:27.064044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-86c588ad-9a0e-4f6f-9573-eedd2c6c6fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:27.074188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:27.174484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c588ad-9a0e-4f6f-9573-eedd2c6c6fc0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:27.252028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2f0f-c779-44f7-9253-b5ca19012d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:27.252703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2f0f-c779-44f7-9253-b5ca19012d3a service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:27.252979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2f0f-c779-44f7-9253-b5ca19012d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:27.253216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2f0f-c779-44f7-9253-b5ca19012d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:27.254961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-66ce2f0f-c779-44f7-9253-b5ca19012d3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:27.318046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:27.368854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2f0f-c779-44f7-9253-b5ca19012d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:27.370317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2f0f-c779-44f7-9253-b5ca19012d3a service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:27.388836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 642/1317] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:29.954606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc553a4-e4b5-4342-a918-921c4c04d09c None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:29.955156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc553a4-e4b5-4342-a918-921c4c04d09c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:29.955156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc553a4-e4b5-4342-a918-921c4c04d09c None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:29.956503 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 676/1318] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:29.962192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c70d0-2b10-4d5b-9234-8efaf6998f6b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:29.963085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c70d0-2b10-4d5b-9234-8efaf6998f6b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:29.963366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c70d0-2b10-4d5b-9234-8efaf6998f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:30.037796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e34c70d0-2b10-4d5b-9234-8efaf6998f6b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:30.039048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e34c70d0-2b10-4d5b-9234-8efaf6998f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:30.164096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 643/1319] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:30.211041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc553a4-e4b5-4342-a918-921c4c04d09c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:30.211041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-abc553a4-e4b5-4342-a918-921c4c04d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:30.320644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc553a4-e4b5-4342-a918-921c4c04d09c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:30.405888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69345ac8-401d-45b2-9bdb-331c6e94ab69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:30.406902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69345ac8-401d-45b2-9bdb-331c6e94ab69 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:30.407182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69345ac8-401d-45b2-9bdb-331c6e94ab69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:30.407454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69345ac8-401d-45b2-9bdb-331c6e94ab69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:30.409131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-69345ac8-401d-45b2-9bdb-331c6e94ab69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:30.418357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:30.529351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69345ac8-401d-45b2-9bdb-331c6e94ab69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:30.530739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69345ac8-401d-45b2-9bdb-331c6e94ab69 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:30.550083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 677/1320] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:33.287832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78907fc-8078-496f-bec8-5746c5592739 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:33.288402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78907fc-8078-496f-bec8-5746c5592739 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:33.288402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78907fc-8078-496f-bec8-5746c5592739 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:33.289783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 644/1321] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:33.295341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41d5f-411f-4f99-95e4-76dcd5abbc84 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:33.295791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41d5f-411f-4f99-95e4-76dcd5abbc84 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:33.295886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41d5f-411f-4f99-95e4-76dcd5abbc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:33.368683 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-7fc41d5f-411f-4f99-95e4-76dcd5abbc84 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:33.369897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-7fc41d5f-411f-4f99-95e4-76dcd5abbc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:33.430968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:33.479251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 678/1322] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:33.515823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78907fc-8078-496f-bec8-5746c5592739 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:33.517426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b78907fc-8078-496f-bec8-5746c5592739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:33.540987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:33.640775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78907fc-8078-496f-bec8-5746c5592739 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:33.721064 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95bed0-9ff6-4403-8a82-2d82e9f0aeab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:33.721711 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95bed0-9ff6-4403-8a82-2d82e9f0aeab service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:33.721990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95bed0-9ff6-4403-8a82-2d82e9f0aeab service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:33.722246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95bed0-9ff6-4403-8a82-2d82e9f0aeab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:33.724100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4e95bed0-9ff6-4403-8a82-2d82e9f0aeab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:33.800066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:33.840454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95bed0-9ff6-4403-8a82-2d82e9f0aeab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:33.842052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95bed0-9ff6-4403-8a82-2d82e9f0aeab service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:33.861004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 645/1323] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:35.959078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f8a7-ae83-47e4-82fc-2b767d3514fd None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:35.959665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f8a7-ae83-47e4-82fc-2b767d3514fd None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:35.959665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f8a7-ae83-47e4-82fc-2b767d3514fd None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:35.960888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 679/1324] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:35.966460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b14ae4-8f74-439e-a3a0-5e55dffb0f3e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:35.967056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b14ae4-8f74-439e-a3a0-5e55dffb0f3e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:35.967056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b14ae4-8f74-439e-a3a0-5e55dffb0f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:36.034456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a3b14ae4-8f74-439e-a3a0-5e55dffb0f3e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:36.035827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a3b14ae4-8f74-439e-a3a0-5e55dffb0f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:36.133423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 646/1325] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:36.183848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0974c16-2617-4da7-8f19-a8e6284c04e6 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:36.184113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0974c16-2617-4da7-8f19-a8e6284c04e6 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:36.184388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0974c16-2617-4da7-8f19-a8e6284c04e6 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:36.185757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 680/1326] 10.222.0.66 () {54 vars in 964 bytes} [Wed Jun 22 10:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:36.192350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cf8ad-59f9-4519-9833-4bfc1067b54c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:36.192648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cf8ad-59f9-4519-9833-4bfc1067b54c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:36.192876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cf8ad-59f9-4519-9833-4bfc1067b54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:36.224671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:36.271241 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9f0cf8ad-59f9-4519-9833-4bfc1067b54c None None] MFA Rules not processed for user `0afeafd76edb40289d715f81485fa7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:36.272431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9f0cf8ad-59f9-4519-9833-4bfc1067b54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:36.361675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 647/1327] 10.222.0.66 () {58 vars in 1061 bytes} [Wed Jun 22 10:12:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:12:36.373158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0974c16-2617-4da7-8f19-a8e6284c04e6 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:36.374761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a0974c16-2617-4da7-8f19-a8e6284c04e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:36.482978 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0974c16-2617-4da7-8f19-a8e6284c04e6 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:36.568562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8f148-9d3f-4168-ae08-b913df5fd1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:36.569228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8f148-9d3f-4168-ae08-b913df5fd1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:36.569512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8f148-9d3f-4168-ae08-b913df5fd1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:36.569788 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8f148-9d3f-4168-ae08-b913df5fd1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:36.571530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4ed8f148-9d3f-4168-ae08-b913df5fd1b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:36.590229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:36.694568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8f148-9d3f-4168-ae08-b913df5fd1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:36.696053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8f148-9d3f-4168-ae08-b913df5fd1b7 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:36.716223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 681/1328] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:38.985188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391ceed-ebc0-4278-aae0-7b028d3ec4ab None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:38.985734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391ceed-ebc0-4278-aae0-7b028d3ec4ab None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:38.985734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391ceed-ebc0-4278-aae0-7b028d3ec4ab None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:38.987023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 648/1329] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:38.992857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b673ee-cab1-4afa-8c0e-59b4e87970f3 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:38.993252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b673ee-cab1-4afa-8c0e-59b4e87970f3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:38.993405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b673ee-cab1-4afa-8c0e-59b4e87970f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:39.063043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-84b673ee-cab1-4afa-8c0e-59b4e87970f3 None None] MFA Rules not processed for user `6120ce90d3f04398b54f4c0245ad6ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:39.064267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-84b673ee-cab1-4afa-8c0e-59b4e87970f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:39.132504 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:39.184898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 682/1330] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:39.222419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391ceed-ebc0-4278-aae0-7b028d3ec4ab None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:39.224087 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d391ceed-ebc0-4278-aae0-7b028d3ec4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:39.334386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391ceed-ebc0-4278-aae0-7b028d3ec4ab None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:39.354959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:39.413002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca80df-5dc3-495e-b6d4-5a1b5c3c0010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:39.413572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca80df-5dc3-495e-b6d4-5a1b5c3c0010 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:39.413859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca80df-5dc3-495e-b6d4-5a1b5c3c0010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:39.414132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca80df-5dc3-495e-b6d4-5a1b5c3c0010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:39.415809 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bbca80df-5dc3-495e-b6d4-5a1b5c3c0010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:39.530322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca80df-5dc3-495e-b6d4-5a1b5c3c0010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:39.532112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca80df-5dc3-495e-b6d4-5a1b5c3c0010 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:39.551390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 649/1331] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:42.014705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bba8e3-695a-43bd-bb42-b343251f42dd None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:42.015253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bba8e3-695a-43bd-bb42-b343251f42dd None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:42.015253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bba8e3-695a-43bd-bb42-b343251f42dd None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:42.016573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 683/1332] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:42.022106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ee1c0-d0a1-454b-a201-ff43b8f7cbf0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:42.022587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ee1c0-d0a1-454b-a201-ff43b8f7cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:42.022682 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ee1c0-d0a1-454b-a201-ff43b8f7cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:42.088772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:42.091928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-dc0ee1c0-d0a1-454b-a201-ff43b8f7cbf0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:42.093570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dc0ee1c0-d0a1-454b-a201-ff43b8f7cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:42.198259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 650/1333] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:42.234581 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bba8e3-695a-43bd-bb42-b343251f42dd None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:42.236117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d9bba8e3-695a-43bd-bb42-b343251f42dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:42.356234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bba8e3-695a-43bd-bb42-b343251f42dd None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:42.434938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463712e3-1233-4142-8f2d-554722819078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:42.435608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463712e3-1233-4142-8f2d-554722819078 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:42.435890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463712e3-1233-4142-8f2d-554722819078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:42.436163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463712e3-1233-4142-8f2d-554722819078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:42.437816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-463712e3-1233-4142-8f2d-554722819078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:42.466044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:42.554201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463712e3-1233-4142-8f2d-554722819078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:42.555604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463712e3-1233-4142-8f2d-554722819078 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:42.574269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 684/1334] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:44.634371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caec4d-524e-4b73-8367-2c8f269bb796 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:44.634954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caec4d-524e-4b73-8367-2c8f269bb796 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:44.634954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caec4d-524e-4b73-8367-2c8f269bb796 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:44.636372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 651/1335] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:44.642336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f048a8-2d02-4694-ba9d-43a50e6fdb27 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:44.642336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f048a8-2d02-4694-ba9d-43a50e6fdb27 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:44.642832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f048a8-2d02-4694-ba9d-43a50e6fdb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:44.711005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c1f048a8-2d02-4694-ba9d-43a50e6fdb27 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:44.712244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c1f048a8-2d02-4694-ba9d-43a50e6fdb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:44.790258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:44.813842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 685/1336] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:44.853786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caec4d-524e-4b73-8367-2c8f269bb796 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:44.855450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c3caec4d-524e-4b73-8367-2c8f269bb796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:44.966175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caec4d-524e-4b73-8367-2c8f269bb796 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:44.995184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:45.043045 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df2fb6-23ad-4fa8-b487-b3d04ff029f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:45.043713 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df2fb6-23ad-4fa8-b487-b3d04ff029f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:45.043989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df2fb6-23ad-4fa8-b487-b3d04ff029f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:45.044252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df2fb6-23ad-4fa8-b487-b3d04ff029f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:45.045909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-77df2fb6-23ad-4fa8-b487-b3d04ff029f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:45.161658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df2fb6-23ad-4fa8-b487-b3d04ff029f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:45.163230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df2fb6-23ad-4fa8-b487-b3d04ff029f5 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:45.182193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 652/1337] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:47.673774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d68c5-1eb5-4965-b278-311adef07cd6 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:47.674329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d68c5-1eb5-4965-b278-311adef07cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:47.674329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d68c5-1eb5-4965-b278-311adef07cd6 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:47.675794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 686/1338] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:47.681171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959c407-f813-4726-9747-54046b282340 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:47.681604 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959c407-f813-4726-9747-54046b282340 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:47.681804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959c407-f813-4726-9747-54046b282340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:47.748642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c959c407-f813-4726-9747-54046b282340 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:47.749851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c959c407-f813-4726-9747-54046b282340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:47.758468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:47.850894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 653/1339] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:47.886827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d68c5-1eb5-4965-b278-311adef07cd6 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:47.888376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b70d68c5-1eb5-4965-b278-311adef07cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:47.994533 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d68c5-1eb5-4965-b278-311adef07cd6 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:48.071264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191a19-5fdd-421d-998d-5ad4e54417fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:48.071923 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191a19-5fdd-421d-998d-5ad4e54417fa service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:48.072207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191a19-5fdd-421d-998d-5ad4e54417fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:48.072482 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191a19-5fdd-421d-998d-5ad4e54417fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:48.074132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-93191a19-5fdd-421d-998d-5ad4e54417fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:48.110543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:48.188732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191a19-5fdd-421d-998d-5ad4e54417fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:48.190187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191a19-5fdd-421d-998d-5ad4e54417fa service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:48.209014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 687/1340] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:52.450319 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e458b-c00a-47dd-9164-8f098e19a8cf None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:52.451042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e458b-c00a-47dd-9164-8f098e19a8cf None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:52.451042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e458b-c00a-47dd-9164-8f098e19a8cf None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:52.453500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 654/1341] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:12:52.460095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c37f16-45db-410e-9f17-ecc301be84f9 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:52.460756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c37f16-45db-410e-9f17-ecc301be84f9 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:52.461366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c37f16-45db-410e-9f17-ecc301be84f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:52.559630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-36c37f16-45db-410e-9f17-ecc301be84f9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:52.561234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-36c37f16-45db-410e-9f17-ecc301be84f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:52.690496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:52.710755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 688/1342] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:52.754924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e458b-c00a-47dd-9164-8f098e19a8cf None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:52.757219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c96e458b-c00a-47dd-9164-8f098e19a8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:52.926855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e458b-c00a-47dd-9164-8f098e19a8cf None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:52.932815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2565258-226b-4d1e-b772-9365159c2b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:52.933900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2565258-226b-4d1e-b772-9365159c2b35 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:52.934366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2565258-226b-4d1e-b772-9365159c2b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:52.934870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2565258-226b-4d1e-b772-9365159c2b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:52.951568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2565258-226b-4d1e-b772-9365159c2b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:52.954319 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2565258-226b-4d1e-b772-9365159c2b35 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:52.973345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 655/1343] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:55.802105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b47217-385b-4bff-9686-5b9cdf2fb1bf None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:55.803014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b47217-385b-4bff-9686-5b9cdf2fb1bf None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:55.803014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b47217-385b-4bff-9686-5b9cdf2fb1bf None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:55.804169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 689/1344] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:55.813735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68678a-1b6a-4a1c-a35a-b7ec58ecc49c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:55.814388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68678a-1b6a-4a1c-a35a-b7ec58ecc49c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:55.814767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68678a-1b6a-4a1c-a35a-b7ec58ecc49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:55.852904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1b68678a-1b6a-4a1c-a35a-b7ec58ecc49c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:55.854400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1b68678a-1b6a-4a1c-a35a-b7ec58ecc49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:55.891631 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:55.966039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 656/1345] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:56.004992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b47217-385b-4bff-9686-5b9cdf2fb1bf None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:56.007441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e7b47217-385b-4bff-9686-5b9cdf2fb1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:56.024437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b47217-385b-4bff-9686-5b9cdf2fb1bf None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:56.029628 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b932c4-e68d-465d-ad1d-b3f5ef5d560c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:56.030424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b932c4-e68d-465d-ad1d-b3f5ef5d560c service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:56.030818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b932c4-e68d-465d-ad1d-b3f5ef5d560c service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:56.031472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b932c4-e68d-465d-ad1d-b3f5ef5d560c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:56.043899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b932c4-e68d-465d-ad1d-b3f5ef5d560c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:56.045640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b932c4-e68d-465d-ad1d-b3f5ef5d560c service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:56.058065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 690/1346] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:00.658123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7857-94e2-41b4-8e90-89ccd29bf89a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:00.658654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7857-94e2-41b4-8e90-89ccd29bf89a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:00.658821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7857-94e2-41b4-8e90-89ccd29bf89a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:00.660260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 657/1347] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:00.665973 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019191ce-ba2c-4a0b-ab10-e6b8d4da28fa None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:00.666454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019191ce-ba2c-4a0b-ab10-e6b8d4da28fa None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:00.666593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019191ce-ba2c-4a0b-ab10-e6b8d4da28fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:00.685287 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-019191ce-ba2c-4a0b-ab10-e6b8d4da28fa None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:00.686628 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-019191ce-ba2c-4a0b-ab10-e6b8d4da28fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:00.695092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 691/1348] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:00.732836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7857-94e2-41b4-8e90-89ccd29bf89a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:00.744320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7857-94e2-41b4-8e90-89ccd29bf89a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:00.748301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bb1b8-70a7-42df-a1b9-3e9f0207696a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:00.748942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bb1b8-70a7-42df-a1b9-3e9f0207696a service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:00.749219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bb1b8-70a7-42df-a1b9-3e9f0207696a service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:00.749485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bb1b8-70a7-42df-a1b9-3e9f0207696a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:00.759625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bb1b8-70a7-42df-a1b9-3e9f0207696a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:00.761060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bb1b8-70a7-42df-a1b9-3e9f0207696a service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:00.771358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 658/1349] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:05.971440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9d3a-7d4c-46a2-872d-ded33a57eb88 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:05.972069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9d3a-7d4c-46a2-872d-ded33a57eb88 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:05.972069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9d3a-7d4c-46a2-872d-ded33a57eb88 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:05.973966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 692/1350] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:13:05.987697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40895264-b220-4c06-aa84-079a4454c6ec None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:05.988541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40895264-b220-4c06-aa84-079a4454c6ec None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:05.989318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40895264-b220-4c06-aa84-079a4454c6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:06.079560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-40895264-b220-4c06-aa84-079a4454c6ec None None] MFA Rules not processed for user `9b257dee0ca3400f860ef9bd8c7a4e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:06.081838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-40895264-b220-4c06-aa84-079a4454c6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:06.220801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 659/1351] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:13:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:10.679753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=13 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:11.176373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d6ef7-d2ca-48d0-914e-916654083033 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:11.177802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d6ef7-d2ca-48d0-914e-916654083033 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:11.178347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d6ef7-d2ca-48d0-914e-916654083033 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:11.179926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 693/1352] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:11.186587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4aa21-cd2f-409b-b941-26af53058993 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:11.187115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4aa21-cd2f-409b-b941-26af53058993 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:11.187115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4aa21-cd2f-409b-b941-26af53058993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:11.208387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bef4aa21-cd2f-409b-b941-26af53058993 None None] MFA Rules not processed for user `9b257dee0ca3400f860ef9bd8c7a4e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:11.209641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bef4aa21-cd2f-409b-b941-26af53058993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:11.219428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 660/1353] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:13:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:13:12.592299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adbc89-f4ba-4147-9397-b911cc578d2e None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:12.593150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adbc89-f4ba-4147-9397-b911cc578d2e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:12.593332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adbc89-f4ba-4147-9397-b911cc578d2e None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:12.595112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 694/1354] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:12.601396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39803a23-9bf4-4878-b3ff-7a8fe0d2a02f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:12.601962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39803a23-9bf4-4878-b3ff-7a8fe0d2a02f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:12.601962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39803a23-9bf4-4878-b3ff-7a8fe0d2a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:12.622185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-39803a23-9bf4-4878-b3ff-7a8fe0d2a02f None None] MFA Rules not processed for user `9b257dee0ca3400f860ef9bd8c7a4e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:12.623434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-39803a23-9bf4-4878-b3ff-7a8fe0d2a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:12.633458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 661/1355] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:13:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:13:16.433342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2e8e-14fc-4bac-85bb-20fbd177d361 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:16.433995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2e8e-14fc-4bac-85bb-20fbd177d361 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:16.433995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2e8e-14fc-4bac-85bb-20fbd177d361 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:16.435660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 695/1356] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:16.441980 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c09924-08f1-4d14-a4f1-c3b570e59ed9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:16.442866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c09924-08f1-4d14-a4f1-c3b570e59ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:16.443029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c09924-08f1-4d14-a4f1-c3b570e59ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:16.463412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b3c09924-08f1-4d14-a4f1-c3b570e59ed9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:16.464756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b3c09924-08f1-4d14-a4f1-c3b570e59ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:16.474260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 662/1357] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:16.532794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991bf36-bf24-4d99-99a8-f4d52549210c None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:16.533569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991bf36-bf24-4d99-99a8-f4d52549210c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:16.534381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991bf36-bf24-4d99-99a8-f4d52549210c None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:16.536831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 696/1358] 10.222.0.66 () {54 vars in 961 bytes} [Wed Jun 22 10:13:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:16.544921 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8197be-6022-4093-bd82-88fecddce6e1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:16.545916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8197be-6022-4093-bd82-88fecddce6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:16.546423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8197be-6022-4093-bd82-88fecddce6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:16.603958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:16.615502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9f8197be-6022-4093-bd82-88fecddce6e1 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:16.626102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9f8197be-6022-4093-bd82-88fecddce6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:16.778489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 663/1359] 10.222.0.66 () {58 vars in 1058 bytes} [Wed Jun 22 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:13:16.794727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991bf36-bf24-4d99-99a8-f4d52549210c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:16.833887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991bf36-bf24-4d99-99a8-f4d52549210c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:16.846415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6b58f-082c-4a91-9e55-feed62a51554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:16.847778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6b58f-082c-4a91-9e55-feed62a51554 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:16.848743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6b58f-082c-4a91-9e55-feed62a51554 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:16.849500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6b58f-082c-4a91-9e55-feed62a51554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:16.860695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6b58f-082c-4a91-9e55-feed62a51554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:16.863096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6b58f-082c-4a91-9e55-feed62a51554 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:16.890588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 697/1360] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:19.974918 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43c17b-f364-420e-bba2-28cd2d3d148c None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:19.975550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43c17b-f364-420e-bba2-28cd2d3d148c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:19.975955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43c17b-f364-420e-bba2-28cd2d3d148c None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:19.978943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 664/1361] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:19.988665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81602aab-7a89-48ca-9d5b-9655389bc585 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:19.989534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81602aab-7a89-48ca-9d5b-9655389bc585 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:19.990039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81602aab-7a89-48ca-9d5b-9655389bc585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:20.020537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-81602aab-7a89-48ca-9d5b-9655389bc585 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:20.022464 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-81602aab-7a89-48ca-9d5b-9655389bc585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:20.037214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 698/1362] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:20.089892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43c17b-f364-420e-bba2-28cd2d3d148c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:20.106608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43c17b-f364-420e-bba2-28cd2d3d148c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:20.113257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed45735-2517-4aa4-8498-91ceff267734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:20.113928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed45735-2517-4aa4-8498-91ceff267734 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:20.114292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed45735-2517-4aa4-8498-91ceff267734 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:20.114457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed45735-2517-4aa4-8498-91ceff267734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:20.125074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed45735-2517-4aa4-8498-91ceff267734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:20.127139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed45735-2517-4aa4-8498-91ceff267734 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:20.146822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 665/1363] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:23.225752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9058-4d1f-45c0-88f9-97a6d9c6ccc6 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:23.226640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9058-4d1f-45c0-88f9-97a6d9c6ccc6 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:23.226802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9058-4d1f-45c0-88f9-97a6d9c6ccc6 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:23.229083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 699/1364] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:23.235891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08480576-3b28-41ad-b0a7-3f3f83f3befb None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:23.236455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08480576-3b28-41ad-b0a7-3f3f83f3befb None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:23.236724 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08480576-3b28-41ad-b0a7-3f3f83f3befb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:23.263098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-08480576-3b28-41ad-b0a7-3f3f83f3befb None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:23.265078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-08480576-3b28-41ad-b0a7-3f3f83f3befb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:23.274652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 666/1365] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:23.324046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad4668-e957-4a32-bd66-fe6bf7fbd8d4 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:23.324363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad4668-e957-4a32-bd66-fe6bf7fbd8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:23.324830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad4668-e957-4a32-bd66-fe6bf7fbd8d4 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:23.326881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 700/1366] 10.222.0.66 () {54 vars in 961 bytes} [Wed Jun 22 10:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:23.333243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303068f6-c785-489b-b697-546d7ee44bb9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:23.334232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303068f6-c785-489b-b697-546d7ee44bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:23.335003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303068f6-c785-489b-b697-546d7ee44bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:23.355558 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-303068f6-c785-489b-b697-546d7ee44bb9 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:23.357157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-303068f6-c785-489b-b697-546d7ee44bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:23.369583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 667/1367] 10.222.0.66 () {58 vars in 1058 bytes} [Wed Jun 22 10:13:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:23.379516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad4668-e957-4a32-bd66-fe6bf7fbd8d4 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:23.406210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad4668-e957-4a32-bd66-fe6bf7fbd8d4 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:23.413965 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852436a0-2556-4e79-9925-71bc57b509ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:23.414690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852436a0-2556-4e79-9925-71bc57b509ab service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:23.415169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852436a0-2556-4e79-9925-71bc57b509ab service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:23.415600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852436a0-2556-4e79-9925-71bc57b509ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:23.426142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852436a0-2556-4e79-9925-71bc57b509ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:23.428122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852436a0-2556-4e79-9925-71bc57b509ab service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:23.454380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 701/1368] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:25.622280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365fe64-6a23-4672-9620-9cedff674a2b None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:25.623486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365fe64-6a23-4672-9620-9cedff674a2b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:25.623998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365fe64-6a23-4672-9620-9cedff674a2b None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:25.627532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 668/1369] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:25.631604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153e26-562a-4996-b3a4-dd4ad7848084 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:25.632095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153e26-562a-4996-b3a4-dd4ad7848084 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:25.632177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153e26-562a-4996-b3a4-dd4ad7848084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:25.658221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-03153e26-562a-4996-b3a4-dd4ad7848084 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:25.660203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-03153e26-562a-4996-b3a4-dd4ad7848084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:25.670673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 702/1370] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:25.717637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365fe64-6a23-4672-9620-9cedff674a2b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:25.734227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365fe64-6a23-4672-9620-9cedff674a2b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:25.740702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da719a19-33fa-477c-b1c5-c305f4cd37ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:25.741377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719a19-33fa-477c-b1c5-c305f4cd37ed service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:25.741661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719a19-33fa-477c-b1c5-c305f4cd37ed service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:25.741942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719a19-33fa-477c-b1c5-c305f4cd37ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:25.754912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da719a19-33fa-477c-b1c5-c305f4cd37ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:25.757255 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da719a19-33fa-477c-b1c5-c305f4cd37ed service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:25.772249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 669/1371] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:26.613400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafedd08-55f7-4859-a657-d38a4cddc3be None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:26.614189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafedd08-55f7-4859-a657-d38a4cddc3be None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:26.614729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafedd08-55f7-4859-a657-d38a4cddc3be None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:26.616341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 703/1372] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:13:26.622455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ba40a-753d-454e-8952-fd8f1315130e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:26.623487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ba40a-753d-454e-8952-fd8f1315130e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:26.623983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ba40a-753d-454e-8952-fd8f1315130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:26.648231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5e9ba40a-753d-454e-8952-fd8f1315130e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:26.649798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5e9ba40a-753d-454e-8952-fd8f1315130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:26.659121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 670/1373] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:13:26.977283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4e079-62fe-4d9e-8ed9-497fe3bb23c5 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:26.978264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4e079-62fe-4d9e-8ed9-497fe3bb23c5 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:26.978582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4e079-62fe-4d9e-8ed9-497fe3bb23c5 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:26.980334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 704/1374] 10.222.0.66 () {54 vars in 963 bytes} [Wed Jun 22 10:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:26.986593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af6444-95e4-44b2-b928-0c08efc0692e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:26.986956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af6444-95e4-44b2-b928-0c08efc0692e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:26.987284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af6444-95e4-44b2-b928-0c08efc0692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:27.046177 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b3af6444-95e4-44b2-b928-0c08efc0692e None None] MFA Rules not processed for user `3748ece05182480f90a70dc587f2a007`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:27.047469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b3af6444-95e4-44b2-b928-0c08efc0692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:27.165012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 671/1375] 10.222.0.66 () {58 vars in 1060 bytes} [Wed Jun 22 10:13:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:27.178219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4e079-62fe-4d9e-8ed9-497fe3bb23c5 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:27.197508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4e079-62fe-4d9e-8ed9-497fe3bb23c5 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:27.204222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620412c-fb54-4483-9b73-663cb9a6e915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:27.205350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620412c-fb54-4483-9b73-663cb9a6e915 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:27.205888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620412c-fb54-4483-9b73-663cb9a6e915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:27.206374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620412c-fb54-4483-9b73-663cb9a6e915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:27.223508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620412c-fb54-4483-9b73-663cb9a6e915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:27.226003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620412c-fb54-4483-9b73-663cb9a6e915 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:27.244683 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 705/1376] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:28.696277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e473-4d23-4502-a9b7-734afe356361 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:28.696957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e473-4d23-4502-a9b7-734afe356361 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:28.696957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e473-4d23-4502-a9b7-734afe356361 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:28.698202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 672/1377] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:28.704821 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf4e88-896f-492b-80fe-f7aa263a8d87 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:28.705661 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf4e88-896f-492b-80fe-f7aa263a8d87 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:28.705854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf4e88-896f-492b-80fe-f7aa263a8d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:28.726183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-44cf4e88-896f-492b-80fe-f7aa263a8d87 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:28.727458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-44cf4e88-896f-492b-80fe-f7aa263a8d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:28.736682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 706/1378] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:28.787340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292e473-4d23-4502-a9b7-734afe356361 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:28.804359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292e473-4d23-4502-a9b7-734afe356361 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:28.811306 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c4886-e47d-4b12-859a-b383dc6eae39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:28.812188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4886-e47d-4b12-859a-b383dc6eae39 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:28.812607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4886-e47d-4b12-859a-b383dc6eae39 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:28.813011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4886-e47d-4b12-859a-b383dc6eae39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:28.824261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c4886-e47d-4b12-859a-b383dc6eae39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:28.826110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c4886-e47d-4b12-859a-b383dc6eae39 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:28.831466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:28.841447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 673/1379] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:31.033298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f9e3-7c64-4de0-bd34-7225084e8ad7 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:31.034069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f9e3-7c64-4de0-bd34-7225084e8ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:31.034069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f9e3-7c64-4de0-bd34-7225084e8ad7 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:31.035430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 707/1380] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:31.041925 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfe16e-a1a7-43c5-876d-6f699ce240c6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:31.042494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfe16e-a1a7-43c5-876d-6f699ce240c6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:31.042813 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfe16e-a1a7-43c5-876d-6f699ce240c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:31.067808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-01bfe16e-a1a7-43c5-876d-6f699ce240c6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:31.069146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-01bfe16e-a1a7-43c5-876d-6f699ce240c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:31.079550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 674/1381] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:31.136145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536f9e3-7c64-4de0-bd34-7225084e8ad7 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:31.155558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536f9e3-7c64-4de0-bd34-7225084e8ad7 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:31.163393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67be8d4-85df-4a03-9802-b40a9c69690a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:31.164374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67be8d4-85df-4a03-9802-b40a9c69690a service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:31.165001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67be8d4-85df-4a03-9802-b40a9c69690a service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:31.165370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67be8d4-85df-4a03-9802-b40a9c69690a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:31.178043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67be8d4-85df-4a03-9802-b40a9c69690a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:31.180138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67be8d4-85df-4a03-9802-b40a9c69690a service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:31.193725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 708/1382] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:33.458525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2e13d-efcc-4881-b047-c623654e2ebd None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:33.459392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2e13d-efcc-4881-b047-c623654e2ebd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:33.459392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2e13d-efcc-4881-b047-c623654e2ebd None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:33.460535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 675/1383] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:13:33.466701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff6097-c46c-4dfc-acea-0bbfd915f895 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:33.467534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff6097-c46c-4dfc-acea-0bbfd915f895 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:33.467534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff6097-c46c-4dfc-acea-0bbfd915f895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:33.486327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-edff6097-c46c-4dfc-acea-0bbfd915f895 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:33.487669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-edff6097-c46c-4dfc-acea-0bbfd915f895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:33.496191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 709/1384] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:13:33.538843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2e13d-efcc-4881-b047-c623654e2ebd None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:33.554298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2e13d-efcc-4881-b047-c623654e2ebd None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:33.560476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d626b-407c-46b1-b1ed-8e8d726c956d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:33.561368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d626b-407c-46b1-b1ed-8e8d726c956d service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:33.561801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d626b-407c-46b1-b1ed-8e8d726c956d service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:33.562216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d626b-407c-46b1-b1ed-8e8d726c956d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:33.572164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d626b-407c-46b1-b1ed-8e8d726c956d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:33.574054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d626b-407c-46b1-b1ed-8e8d726c956d service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:33.585948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 676/1385] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:13:36.491387 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76701-d220-4376-80f7-434b275fe2b8 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:36.492470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76701-d220-4376-80f7-434b275fe2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:36.493001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76701-d220-4376-80f7-434b275fe2b8 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:36.495013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 710/1386] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:36.504422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313731a-64c0-4a3d-8312-9c3437368d0f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:36.505027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313731a-64c0-4a3d-8312-9c3437368d0f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:36.505401 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313731a-64c0-4a3d-8312-9c3437368d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:36.537189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9313731a-64c0-4a3d-8312-9c3437368d0f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:36.539508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9313731a-64c0-4a3d-8312-9c3437368d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:36.553573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 677/1387] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:36.631071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76701-d220-4376-80f7-434b275fe2b8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:36.662019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76701-d220-4376-80f7-434b275fe2b8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:36.672320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc700f27-2f14-42f3-adb3-e86aed300d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:36.673444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc700f27-2f14-42f3-adb3-e86aed300d84 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:36.673955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc700f27-2f14-42f3-adb3-e86aed300d84 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:36.674484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc700f27-2f14-42f3-adb3-e86aed300d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:36.691342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc700f27-2f14-42f3-adb3-e86aed300d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:36.694428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc700f27-2f14-42f3-adb3-e86aed300d84 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:36.714612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 711/1388] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:38.947495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382005c8-ca25-42dc-b71d-4923ef08e7a6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:38.948367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382005c8-ca25-42dc-b71d-4923ef08e7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:38.948367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382005c8-ca25-42dc-b71d-4923ef08e7a6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:38.950866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 678/1389] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:13:38.957447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a99a50-ff31-4475-8830-2eaf595387c5 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:38.958079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a99a50-ff31-4475-8830-2eaf595387c5 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:38.958079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a99a50-ff31-4475-8830-2eaf595387c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:38.978632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d6a99a50-ff31-4475-8830-2eaf595387c5 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:38.979899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d6a99a50-ff31-4475-8830-2eaf595387c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:38.989321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 712/1390] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:39.035852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382005c8-ca25-42dc-b71d-4923ef08e7a6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:39.062363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382005c8-ca25-42dc-b71d-4923ef08e7a6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:39.068498 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3c380-5772-4ab1-b222-b6708e675cdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:39.069195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3c380-5772-4ab1-b222-b6708e675cdf service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:39.069476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3c380-5772-4ab1-b222-b6708e675cdf service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:39.069753 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3c380-5772-4ab1-b222-b6708e675cdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:39.079299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3c380-5772-4ab1-b222-b6708e675cdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:39.081019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3c380-5772-4ab1-b222-b6708e675cdf service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:39.092119 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 679/1391] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:41.354478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974b04-e1e2-44a2-a37a-694d6d505805 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:41.355240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974b04-e1e2-44a2-a37a-694d6d505805 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:41.355512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974b04-e1e2-44a2-a37a-694d6d505805 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:41.357974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 713/1392] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:41.364382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fca6c-6787-4a2e-8763-f213b0fa20b5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:41.364952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fca6c-6787-4a2e-8763-f213b0fa20b5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:41.365501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fca6c-6787-4a2e-8763-f213b0fa20b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:41.392605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b85fca6c-6787-4a2e-8763-f213b0fa20b5 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:41.394300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b85fca6c-6787-4a2e-8763-f213b0fa20b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:41.406870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 680/1393] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:41.467950 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0974b04-e1e2-44a2-a37a-694d6d505805 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:41.476320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=46 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:41.484910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0974b04-e1e2-44a2-a37a-694d6d505805 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:41.492903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a514ceb-b940-40d6-9f18-ee25a955853f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:41.493937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514ceb-b940-40d6-9f18-ee25a955853f service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:41.494430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514ceb-b940-40d6-9f18-ee25a955853f service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:41.494904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514ceb-b940-40d6-9f18-ee25a955853f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:41.507766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a514ceb-b940-40d6-9f18-ee25a955853f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:41.509542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a514ceb-b940-40d6-9f18-ee25a955853f service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:41.520833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 714/1394] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:13:43.695445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34c71-6224-4107-b4c9-3fbf676c4979 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:43.696394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34c71-6224-4107-b4c9-3fbf676c4979 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:43.696394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34c71-6224-4107-b4c9-3fbf676c4979 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:43.697425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 681/1395] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:13:43.703469 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb926a14-4efa-40a8-a845-f59c71a5cc5a None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:43.704303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb926a14-4efa-40a8-a845-f59c71a5cc5a None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:43.704303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb926a14-4efa-40a8-a845-f59c71a5cc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:43.723797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-eb926a14-4efa-40a8-a845-f59c71a5cc5a None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:43.725025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-eb926a14-4efa-40a8-a845-f59c71a5cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:43.734734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 715/1396] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:43.786847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b34c71-6224-4107-b4c9-3fbf676c4979 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:43.804623 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b34c71-6224-4107-b4c9-3fbf676c4979 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:43.813606 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64925c5b-3aa9-4cb0-97ab-41be4ffb3cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:43.814877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925c5b-3aa9-4cb0-97ab-41be4ffb3cbc service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:43.815376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925c5b-3aa9-4cb0-97ab-41be4ffb3cbc service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:43.815852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925c5b-3aa9-4cb0-97ab-41be4ffb3cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:43.831893 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64925c5b-3aa9-4cb0-97ab-41be4ffb3cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:43.834993 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64925c5b-3aa9-4cb0-97ab-41be4ffb3cbc service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:43.853692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 682/1397] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:13:45.151174 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076683b0-5bed-468d-bab0-73dc36e55349 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:45.151991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076683b0-5bed-468d-bab0-73dc36e55349 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:45.152154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076683b0-5bed-468d-bab0-73dc36e55349 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:45.154445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 716/1398] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:45.161991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a166fbc-fe14-42f0-986b-dcf53bb500ba None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:45.162649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a166fbc-fe14-42f0-986b-dcf53bb500ba None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:45.163180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a166fbc-fe14-42f0-986b-dcf53bb500ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:45.194419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2a166fbc-fe14-42f0-986b-dcf53bb500ba None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:45.196622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2a166fbc-fe14-42f0-986b-dcf53bb500ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:45.209450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 683/1399] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:45.272197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c09265-bf2b-4964-b45d-9b21c3c4d7f8 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:45.272616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c09265-bf2b-4964-b45d-9b21c3c4d7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:45.273030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c09265-bf2b-4964-b45d-9b21c3c4d7f8 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:45.274837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 717/1400] 10.222.0.66 () {54 vars in 962 bytes} [Wed Jun 22 10:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:45.280988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c2caa-978d-4318-8079-ffc89ada01cc None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:45.281437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c2caa-978d-4318-8079-ffc89ada01cc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:45.281908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c2caa-978d-4318-8079-ffc89ada01cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:45.339827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2e4c2caa-978d-4318-8079-ffc89ada01cc None None] MFA Rules not processed for user `e0055a33a380435d83a6d7384417c10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:45.341283 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2e4c2caa-978d-4318-8079-ffc89ada01cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:45.414967 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 684/1401] 10.222.0.66 () {58 vars in 1059 bytes} [Wed Jun 22 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:45.423858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c09265-bf2b-4964-b45d-9b21c3c4d7f8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:45.441895 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c09265-bf2b-4964-b45d-9b21c3c4d7f8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:45.447956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf026f8b-2af7-4ddf-9425-2ea7c3036f65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0055a33a380435d83a6d7384417c10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:45.448897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf026f8b-2af7-4ddf-9425-2ea7c3036f65 service glance] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:45.449253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf026f8b-2af7-4ddf-9425-2ea7c3036f65 service glance] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:45.449753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf026f8b-2af7-4ddf-9425-2ea7c3036f65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:45.466702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf026f8b-2af7-4ddf-9425-2ea7c3036f65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:45.469262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf026f8b-2af7-4ddf-9425-2ea7c3036f65 service glance] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:45.487516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 718/1402] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:46.080437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f163e-205f-4361-8b3a-23c69b81ccad None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:46.080809 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f163e-205f-4361-8b3a-23c69b81ccad None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:46.081158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f163e-205f-4361-8b3a-23c69b81ccad None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:46.083160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 685/1403] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:13:46.089122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6efd0-40bd-4bb1-8ebe-8bd7259adda5 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:46.089487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6efd0-40bd-4bb1-8ebe-8bd7259adda5 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:46.089829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6efd0-40bd-4bb1-8ebe-8bd7259adda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:46.119016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-85c6efd0-40bd-4bb1-8ebe-8bd7259adda5 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:46.121175 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-85c6efd0-40bd-4bb1-8ebe-8bd7259adda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:46.135285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 719/1404] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:13:46.215339 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f163e-205f-4361-8b3a-23c69b81ccad None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:46.233857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f163e-205f-4361-8b3a-23c69b81ccad None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:46.240941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f347137-f2b6-4896-9af0-0e433799ccdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:46.241722 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f347137-f2b6-4896-9af0-0e433799ccdd service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:46.242083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f347137-f2b6-4896-9af0-0e433799ccdd service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:46.242459 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f347137-f2b6-4896-9af0-0e433799ccdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:46.256400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f347137-f2b6-4896-9af0-0e433799ccdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:46.259609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f347137-f2b6-4896-9af0-0e433799ccdd service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:46.273527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 686/1405] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:46.311585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd2414-a62b-4fdb-b2c9-2012e94fe211 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:46.313196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd2414-a62b-4fdb-b2c9-2012e94fe211 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:46.313887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd2414-a62b-4fdb-b2c9-2012e94fe211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:46.382623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-1acd2414-a62b-4fdb-b2c9-2012e94fe211 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:46.383889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1acd2414-a62b-4fdb-b2c9-2012e94fe211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:46.468726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 720/1406] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:13:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:46.520124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa3a93-1535-40d2-982a-9c79fa9f161a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:46.520419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa3a93-1535-40d2-982a-9c79fa9f161a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:46.520686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa3a93-1535-40d2-982a-9c79fa9f161a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:46.522241 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 687/1407] 10.222.0.66 () {54 vars in 942 bytes} [Wed Jun 22 10:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:46.532476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4dd99-f00f-4838-bade-c0a59c94c7f6 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:46.532848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4dd99-f00f-4838-bade-c0a59c94c7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:46.533256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4dd99-f00f-4838-bade-c0a59c94c7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:46.603731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-4bc4dd99-f00f-4838-bade-c0a59c94c7f6 None None] MFA Rules not processed for user `b0c07436108d4a2089a74e7891b849c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:46.605605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4bc4dd99-f00f-4838-bade-c0a59c94c7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:46.684228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:46.691787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 721/1408] 10.222.0.66 () {58 vars in 1039 bytes} [Wed Jun 22 10:13:46 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:13:46.701665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa3a93-1535-40d2-982a-9c79fa9f161a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:46.723095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa3a93-1535-40d2-982a-9c79fa9f161a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:46.730619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabd491-d45d-495f-a1f8-c72265c79c21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:46.731847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabd491-d45d-495f-a1f8-c72265c79c21 service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:46.732325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabd491-d45d-495f-a1f8-c72265c79c21 service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:46.732796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabd491-d45d-495f-a1f8-c72265c79c21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:46.744888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dabd491-d45d-495f-a1f8-c72265c79c21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:46.747917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dabd491-d45d-495f-a1f8-c72265c79c21 service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:46.762519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 688/1409] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:13:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:13:56.692292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:56.756484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=81 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:09.455832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b107ad6-a124-4eef-b5ea-ece35d4cbb35 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:09.456430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b107ad6-a124-4eef-b5ea-ece35d4cbb35 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:09.456430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b107ad6-a124-4eef-b5ea-ece35d4cbb35 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:09.457840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 722/1410] 10.222.0.66 () {54 vars in 918 bytes} [Wed Jun 22 10:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:09.466060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71714-aafb-4a6d-9596-d3bb84171088 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:09.466684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71714-aafb-4a6d-9596-d3bb84171088 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:09.466684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71714-aafb-4a6d-9596-d3bb84171088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:09.488304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-dce71714-aafb-4a6d-9596-d3bb84171088 None None] MFA Rules not processed for user `9b257dee0ca3400f860ef9bd8c7a4e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:09.489591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dce71714-aafb-4a6d-9596-d3bb84171088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:09.499004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 689/1411] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Jun 22 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:09.515544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a025-ef1f-4f79-893d-359e863211b2 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:09.515810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a025-ef1f-4f79-893d-359e863211b2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:09.516090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a025-ef1f-4f79-893d-359e863211b2 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:09.517635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 723/1412] 10.222.0.66 () {54 vars in 918 bytes} [Wed Jun 22 10:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:09.523344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da21b6-bdb2-4c7c-ae9c-341bcf3b2e59 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:09.523692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da21b6-bdb2-4c7c-ae9c-341bcf3b2e59 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:09.524012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da21b6-bdb2-4c7c-ae9c-341bcf3b2e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:09.554018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c3da21b6-bdb2-4c7c-ae9c-341bcf3b2e59 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:09.556036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c3da21b6-bdb2-4c7c-ae9c-341bcf3b2e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:09.571634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 690/1413] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Jun 22 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:12.206698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f22fc-2021-41ae-9718-0855931cdb26 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:12.207312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f22fc-2021-41ae-9718-0855931cdb26 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:12.207312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f22fc-2021-41ae-9718-0855931cdb26 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:12.208641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 724/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:14:12.214295 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72509-8bb0-439d-8fc5-43fbbab13bdd None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:12.215097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72509-8bb0-439d-8fc5-43fbbab13bdd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:12.215097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72509-8bb0-439d-8fc5-43fbbab13bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:12.235133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-12a72509-8bb0-439d-8fc5-43fbbab13bdd None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:12.236578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-12a72509-8bb0-439d-8fc5-43fbbab13bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:12.245707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 691/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:14:12.294783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f22fc-2021-41ae-9718-0855931cdb26 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:12.314672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f22fc-2021-41ae-9718-0855931cdb26 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:12.321378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60833f45-7bf9-4592-b1f8-e8e8ae8b0e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:12.322079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60833f45-7bf9-4592-b1f8-e8e8ae8b0e01 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:12.322369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60833f45-7bf9-4592-b1f8-e8e8ae8b0e01 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:12.322709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60833f45-7bf9-4592-b1f8-e8e8ae8b0e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:12.333168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60833f45-7bf9-4592-b1f8-e8e8ae8b0e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:12.334948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60833f45-7bf9-4592-b1f8-e8e8ae8b0e01 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:12.346548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 725/1416] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:13.289400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae44e8d-5398-4356-b96b-db717d81743a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:13.290234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae44e8d-5398-4356-b96b-db717d81743a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:13.290234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae44e8d-5398-4356-b96b-db717d81743a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:13.291498 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 692/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:13.297579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f4389-e622-46bb-9105-bfab6e1437fe None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:13.298292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f4389-e622-46bb-9105-bfab6e1437fe None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:13.298292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f4389-e622-46bb-9105-bfab6e1437fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:13.319154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-ee7f4389-e622-46bb-9105-bfab6e1437fe None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:13.320575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ee7f4389-e622-46bb-9105-bfab6e1437fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:13.330416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 726/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:13.486522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae44e8d-5398-4356-b96b-db717d81743a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:13.503632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae44e8d-5398-4356-b96b-db717d81743a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:13.509454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9cc54-7153-46a4-bda4-78941bea8af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:13.510136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9cc54-7153-46a4-bda4-78941bea8af8 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:13.510636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9cc54-7153-46a4-bda4-78941bea8af8 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:13.510912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9cc54-7153-46a4-bda4-78941bea8af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:13.526626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9cc54-7153-46a4-bda4-78941bea8af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:13.528297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9cc54-7153-46a4-bda4-78941bea8af8 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:13.540268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 693/1419] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:14:14.494766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c06c-56ca-463f-90fa-647d458409e3 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:14.495432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c06c-56ca-463f-90fa-647d458409e3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:14.495432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c06c-56ca-463f-90fa-647d458409e3 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:14.496702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 727/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:14.505791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba6581-c490-4733-8e1c-286cd93219ea None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:14.506398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba6581-c490-4733-8e1c-286cd93219ea None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:14.506794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba6581-c490-4733-8e1c-286cd93219ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:14.531618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c2ba6581-c490-4733-8e1c-286cd93219ea None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:14.533055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c2ba6581-c490-4733-8e1c-286cd93219ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:14.542194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 694/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:14.697565 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c06c-56ca-463f-90fa-647d458409e3 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:14.714673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c06c-56ca-463f-90fa-647d458409e3 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:14.721064 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a361ab-1ca3-4456-ad1b-6db358901b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:14.721765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a361ab-1ca3-4456-ad1b-6db358901b64 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:14.722048 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a361ab-1ca3-4456-ad1b-6db358901b64 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:14.722325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a361ab-1ca3-4456-ad1b-6db358901b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:14.740414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a361ab-1ca3-4456-ad1b-6db358901b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:14.742374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a361ab-1ca3-4456-ad1b-6db358901b64 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:14.757956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 728/1422] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:15.676058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32204a08-1497-44d7-b03f-74633c3b7f13 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:15.676656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32204a08-1497-44d7-b03f-74633c3b7f13 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:15.676656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32204a08-1497-44d7-b03f-74633c3b7f13 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:15.678002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 695/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:15.683894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645f2dc-cb22-4cf2-83fb-29c9a00a8141 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:15.684525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645f2dc-cb22-4cf2-83fb-29c9a00a8141 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:15.684525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645f2dc-cb22-4cf2-83fb-29c9a00a8141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:15.704416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a645f2dc-cb22-4cf2-83fb-29c9a00a8141 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:15.705718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a645f2dc-cb22-4cf2-83fb-29c9a00a8141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:15.714791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 729/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:15.981611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32204a08-1497-44d7-b03f-74633c3b7f13 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:16.006014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32204a08-1497-44d7-b03f-74633c3b7f13 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:16.015576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3657671-c5c0-4b67-8c35-ef6b25d866a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:16.016701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657671-c5c0-4b67-8c35-ef6b25d866a2 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:16.017224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657671-c5c0-4b67-8c35-ef6b25d866a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:16.017704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657671-c5c0-4b67-8c35-ef6b25d866a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:16.034163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3657671-c5c0-4b67-8c35-ef6b25d866a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:16.037240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3657671-c5c0-4b67-8c35-ef6b25d866a2 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:16.053501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 696/1425] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:16.957920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ecec5-4a8b-4d17-9375-2aca78f4d94b None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:16.958484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ecec5-4a8b-4d17-9375-2aca78f4d94b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:16.958484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ecec5-4a8b-4d17-9375-2aca78f4d94b None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:16.959936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 730/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:16.965486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af202f-1da8-4bdd-9020-8768739d7fb3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:16.966115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af202f-1da8-4bdd-9020-8768739d7fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:16.966115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af202f-1da8-4bdd-9020-8768739d7fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:16.984758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d9af202f-1da8-4bdd-9020-8768739d7fb3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:16.986048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d9af202f-1da8-4bdd-9020-8768739d7fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:16.995525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 697/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:17.143755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ecec5-4a8b-4d17-9375-2aca78f4d94b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:17.168845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ecec5-4a8b-4d17-9375-2aca78f4d94b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:17.175270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b2896-439d-43ca-8f19-1816220bf0e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:17.176162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b2896-439d-43ca-8f19-1816220bf0e8 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:17.176518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b2896-439d-43ca-8f19-1816220bf0e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:17.178117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b2896-439d-43ca-8f19-1816220bf0e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:17.189183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b2896-439d-43ca-8f19-1816220bf0e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:17.190863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b2896-439d-43ca-8f19-1816220bf0e8 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:17.202170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 731/1428] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:18.024467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c05a49-66b2-4854-a06b-87a75bc4f0a6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:18.025359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c05a49-66b2-4854-a06b-87a75bc4f0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:18.025359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c05a49-66b2-4854-a06b-87a75bc4f0a6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:18.026977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 698/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:18.033499 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a67da-884e-4579-af8e-89326eeeeec8 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:18.034030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a67da-884e-4579-af8e-89326eeeeec8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:18.034127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a67da-884e-4579-af8e-89326eeeeec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:18.055039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-3c8a67da-884e-4579-af8e-89326eeeeec8 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:18.056749 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3c8a67da-884e-4579-af8e-89326eeeeec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:18.067868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 732/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:14:18.217370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c05a49-66b2-4854-a06b-87a75bc4f0a6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:18.239502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c05a49-66b2-4854-a06b-87a75bc4f0a6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:18.245394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b1e69-e89b-4aaf-9aaa-6d54e68a9e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:18.246057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b1e69-e89b-4aaf-9aaa-6d54e68a9e55 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:18.246343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b1e69-e89b-4aaf-9aaa-6d54e68a9e55 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:18.246670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b1e69-e89b-4aaf-9aaa-6d54e68a9e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:18.256486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b1e69-e89b-4aaf-9aaa-6d54e68a9e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:18.258112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b1e69-e89b-4aaf-9aaa-6d54e68a9e55 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:18.269052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 699/1431] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:19.097555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7419055-65c5-4a34-8118-929e2c7a0331 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:19.098191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7419055-65c5-4a34-8118-929e2c7a0331 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:19.098191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7419055-65c5-4a34-8118-929e2c7a0331 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:19.099454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 733/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:19.105065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879763-2321-4c51-8b8a-4a3cf9ca263c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:19.105781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879763-2321-4c51-8b8a-4a3cf9ca263c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:19.105781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879763-2321-4c51-8b8a-4a3cf9ca263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:19.125655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-86879763-2321-4c51-8b8a-4a3cf9ca263c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:19.127020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-86879763-2321-4c51-8b8a-4a3cf9ca263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:19.135359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 700/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:19.293345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7419055-65c5-4a34-8118-929e2c7a0331 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:19.309787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7419055-65c5-4a34-8118-929e2c7a0331 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:19.316038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309109c6-9fc1-490b-87b5-3c651b4a8b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:19.316712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309109c6-9fc1-490b-87b5-3c651b4a8b4d service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:19.317000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309109c6-9fc1-490b-87b5-3c651b4a8b4d service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:19.317294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309109c6-9fc1-490b-87b5-3c651b4a8b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:19.327111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309109c6-9fc1-490b-87b5-3c651b4a8b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:19.328733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309109c6-9fc1-490b-87b5-3c651b4a8b4d service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:19.341304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 734/1434] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:20.189284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e74380-d3d5-475b-9d13-32533ee158cb None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:20.189930 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e74380-d3d5-475b-9d13-32533ee158cb None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:20.189930 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e74380-d3d5-475b-9d13-32533ee158cb None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:20.191676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 701/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:14:20.197966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9fff-34b3-4845-9abd-de04a68d0f53 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:20.198635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9fff-34b3-4845-9abd-de04a68d0f53 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:20.198757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9fff-34b3-4845-9abd-de04a68d0f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:20.219402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-92aa9fff-34b3-4845-9abd-de04a68d0f53 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:20.220708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-92aa9fff-34b3-4845-9abd-de04a68d0f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:20.229255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 735/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:20.379679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e74380-d3d5-475b-9d13-32533ee158cb None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:20.396889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e74380-d3d5-475b-9d13-32533ee158cb None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:20.403985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3b8e1-9b40-4faf-8fa9-a4b893657f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:20.404662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b8e1-9b40-4faf-8fa9-a4b893657f4a service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:20.404931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b8e1-9b40-4faf-8fa9-a4b893657f4a service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:20.405282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b8e1-9b40-4faf-8fa9-a4b893657f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:20.415402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3b8e1-9b40-4faf-8fa9-a4b893657f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:20.417038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3b8e1-9b40-4faf-8fa9-a4b893657f4a service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:20.428555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 702/1437] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:21.261166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ea7d-0f42-44ef-aad8-68d2f3891476 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:21.261788 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ea7d-0f42-44ef-aad8-68d2f3891476 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:21.261788 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ea7d-0f42-44ef-aad8-68d2f3891476 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:21.263333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 736/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:14:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:21.269839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df510ce1-3965-4d0f-b458-c06bbfd063f5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:21.270743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df510ce1-3965-4d0f-b458-c06bbfd063f5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:21.270911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df510ce1-3965-4d0f-b458-c06bbfd063f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:21.292062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-df510ce1-3965-4d0f-b458-c06bbfd063f5 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:21.293307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-df510ce1-3965-4d0f-b458-c06bbfd063f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:21.302166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 703/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:14:21.584704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ea7d-0f42-44ef-aad8-68d2f3891476 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:21.601194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ea7d-0f42-44ef-aad8-68d2f3891476 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:21.607098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b957b-e213-4337-864a-619cda46e6ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:21.607759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b957b-e213-4337-864a-619cda46e6ff service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:21.608039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b957b-e213-4337-864a-619cda46e6ff service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:21.608301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b957b-e213-4337-864a-619cda46e6ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:21.618119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b957b-e213-4337-864a-619cda46e6ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:21.619800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b957b-e213-4337-864a-619cda46e6ff service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:21.630905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 737/1440] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:23.626024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb557b-f24c-4407-8493-04c962d238f5 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:23.626699 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb557b-f24c-4407-8493-04c962d238f5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:23.626819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb557b-f24c-4407-8493-04c962d238f5 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:23.628348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 704/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:23.637923 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fcac8-1a53-407d-8e1c-efddb9cd4db3 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:23.638605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fcac8-1a53-407d-8e1c-efddb9cd4db3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:23.638991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fcac8-1a53-407d-8e1c-efddb9cd4db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:23.664231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-729fcac8-1a53-407d-8e1c-efddb9cd4db3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:23.665537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-729fcac8-1a53-407d-8e1c-efddb9cd4db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:23.674896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 738/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:23.715741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb557b-f24c-4407-8493-04c962d238f5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:23.731203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb557b-f24c-4407-8493-04c962d238f5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:23.736036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41525e73-acc6-414c-915c-3e1aaa49baca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:23.737192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525e73-acc6-414c-915c-3e1aaa49baca service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:23.737452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525e73-acc6-414c-915c-3e1aaa49baca service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:23.737719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525e73-acc6-414c-915c-3e1aaa49baca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:23.751165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41525e73-acc6-414c-915c-3e1aaa49baca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:23.753007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41525e73-acc6-414c-915c-3e1aaa49baca service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:23.763854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 705/1443] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:26.043547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64594a-8627-4607-977e-fb3d6ebe4f7c None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:26.044089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64594a-8627-4607-977e-fb3d6ebe4f7c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:26.044089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64594a-8627-4607-977e-fb3d6ebe4f7c None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:26.045401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 739/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:26.051234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2329-9c53-4b3d-8cdb-4f8a15aaae31 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:26.051776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2329-9c53-4b3d-8cdb-4f8a15aaae31 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:26.051776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2329-9c53-4b3d-8cdb-4f8a15aaae31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:26.070204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-874b2329-9c53-4b3d-8cdb-4f8a15aaae31 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:26.071470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-874b2329-9c53-4b3d-8cdb-4f8a15aaae31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:26.079815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 706/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:14:26.117964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64594a-8627-4607-977e-fb3d6ebe4f7c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:26.130733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64594a-8627-4607-977e-fb3d6ebe4f7c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:26.135020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa7823-a0bc-43b3-9fdb-4f4b1a47288d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:26.135677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa7823-a0bc-43b3-9fdb-4f4b1a47288d service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:26.135961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa7823-a0bc-43b3-9fdb-4f4b1a47288d service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:26.136231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa7823-a0bc-43b3-9fdb-4f4b1a47288d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:26.146754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa7823-a0bc-43b3-9fdb-4f4b1a47288d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:26.148202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa7823-a0bc-43b3-9fdb-4f4b1a47288d service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:26.159548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 740/1446] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:28.701578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad20af6-dd1b-468a-a537-536c81c8dbfc None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:28.702218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad20af6-dd1b-468a-a537-536c81c8dbfc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:28.702218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad20af6-dd1b-468a-a537-536c81c8dbfc None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:28.703572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 707/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:28.710223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49003e55-8557-485e-add5-082798db49f3 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:28.710942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49003e55-8557-485e-add5-082798db49f3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:28.710942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49003e55-8557-485e-add5-082798db49f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:28.730923 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-49003e55-8557-485e-add5-082798db49f3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:28.732429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-49003e55-8557-485e-add5-082798db49f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:28.741383 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 741/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:14:28.782321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad20af6-dd1b-468a-a537-536c81c8dbfc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:28.802126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad20af6-dd1b-468a-a537-536c81c8dbfc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:28.808266 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b3e41-5768-4a57-a1c0-052a3ee56c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:28.808961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b3e41-5768-4a57-a1c0-052a3ee56c2d service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:28.809238 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b3e41-5768-4a57-a1c0-052a3ee56c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:28.809515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b3e41-5768-4a57-a1c0-052a3ee56c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:28.820693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b3e41-5768-4a57-a1c0-052a3ee56c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:28.822238 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b3e41-5768-4a57-a1c0-052a3ee56c2d service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:28.834271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 708/1449] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:14:31.071842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c821cf-b790-48a2-8749-5593f2abdf63 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:31.072440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c821cf-b790-48a2-8749-5593f2abdf63 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:31.072440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c821cf-b790-48a2-8749-5593f2abdf63 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:31.073980 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 742/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:31.080683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d5570-1970-404e-9bd8-e84e9d804333 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:31.081574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d5570-1970-404e-9bd8-e84e9d804333 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:31.081574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d5570-1970-404e-9bd8-e84e9d804333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:31.101887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ba0d5570-1970-404e-9bd8-e84e9d804333 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:31.103164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ba0d5570-1970-404e-9bd8-e84e9d804333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:31.112695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 709/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:14:31.152664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c821cf-b790-48a2-8749-5593f2abdf63 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:31.165256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c821cf-b790-48a2-8749-5593f2abdf63 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:31.169523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec842a2-8ae2-4860-8c20-328cc54a2d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:31.170288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec842a2-8ae2-4860-8c20-328cc54a2d83 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:31.170730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec842a2-8ae2-4860-8c20-328cc54a2d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:31.171088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec842a2-8ae2-4860-8c20-328cc54a2d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:31.182239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec842a2-8ae2-4860-8c20-328cc54a2d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:31.183831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec842a2-8ae2-4860-8c20-328cc54a2d83 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:31.195424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 743/1452] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:33.377892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792db6-333a-4d55-8089-c6c98e535913 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:33.378557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792db6-333a-4d55-8089-c6c98e535913 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:33.378749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792db6-333a-4d55-8089-c6c98e535913 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:33.380965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 710/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:33.386899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b55b5-ccd3-4013-b2bf-eaec289e3bb6 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:33.387471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b55b5-ccd3-4013-b2bf-eaec289e3bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:33.387471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b55b5-ccd3-4013-b2bf-eaec289e3bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:33.406807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-ac7b55b5-ccd3-4013-b2bf-eaec289e3bb6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:33.408129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ac7b55b5-ccd3-4013-b2bf-eaec289e3bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:33.416718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 744/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:33.457489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68792db6-333a-4d55-8089-c6c98e535913 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:33.470552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68792db6-333a-4d55-8089-c6c98e535913 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:33.474683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9775d54-22da-41bb-99e5-2006bdc7fa98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:33.475349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9775d54-22da-41bb-99e5-2006bdc7fa98 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:33.475629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9775d54-22da-41bb-99e5-2006bdc7fa98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:33.475904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9775d54-22da-41bb-99e5-2006bdc7fa98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:33.486541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9775d54-22da-41bb-99e5-2006bdc7fa98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:33.488275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9775d54-22da-41bb-99e5-2006bdc7fa98 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:33.499359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 711/1455] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:35.655310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732008d-7754-49e7-834f-9515c90a3c5e None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:35.656582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732008d-7754-49e7-834f-9515c90a3c5e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:35.656582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732008d-7754-49e7-834f-9515c90a3c5e None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:35.658299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 745/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:35.665029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529647c5-5aec-4efc-804a-002491a064dd None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:35.665746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529647c5-5aec-4efc-804a-002491a064dd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:35.665746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529647c5-5aec-4efc-804a-002491a064dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:35.687223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-529647c5-5aec-4efc-804a-002491a064dd None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:35.688717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-529647c5-5aec-4efc-804a-002491a064dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:35.698622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 712/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:14:35.740074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732008d-7754-49e7-834f-9515c90a3c5e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:35.752563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732008d-7754-49e7-834f-9515c90a3c5e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:35.756672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8b30c-904b-403a-b741-3b7f9be002b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:35.757341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8b30c-904b-403a-b741-3b7f9be002b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:35.757625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8b30c-904b-403a-b741-3b7f9be002b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:35.757915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8b30c-904b-403a-b741-3b7f9be002b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:35.768871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8b30c-904b-403a-b741-3b7f9be002b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:35.770368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8b30c-904b-403a-b741-3b7f9be002b1 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:35.782316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 746/1458] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:37.978178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62949bad-8076-4a1b-9b5c-bc7f34a13dce None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:37.978838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62949bad-8076-4a1b-9b5c-bc7f34a13dce None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:37.978838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62949bad-8076-4a1b-9b5c-bc7f34a13dce None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:37.980320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 713/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:14:37.986327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11ff08-23f8-4f80-a6fe-7e644a96da2c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:37.987010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11ff08-23f8-4f80-a6fe-7e644a96da2c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:37.987010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11ff08-23f8-4f80-a6fe-7e644a96da2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:37.994178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=70 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:38.008860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-6b11ff08-23f8-4f80-a6fe-7e644a96da2c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:38.010164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-6b11ff08-23f8-4f80-a6fe-7e644a96da2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:38.019471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 747/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:38.060180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62949bad-8076-4a1b-9b5c-bc7f34a13dce None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:38.067467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=73 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:38.074956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62949bad-8076-4a1b-9b5c-bc7f34a13dce None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:38.079012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c653f-e3eb-4a0f-bd0f-2e12e4194411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:38.079716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c653f-e3eb-4a0f-bd0f-2e12e4194411 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:38.080002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c653f-e3eb-4a0f-bd0f-2e12e4194411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:38.080272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c653f-e3eb-4a0f-bd0f-2e12e4194411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:38.090882 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c653f-e3eb-4a0f-bd0f-2e12e4194411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:38.092563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c653f-e3eb-4a0f-bd0f-2e12e4194411 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:38.103758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 714/1461] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:14:40.425840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aedb5-a718-4de1-baa1-1d6d07a34b32 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:40.426445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aedb5-a718-4de1-baa1-1d6d07a34b32 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:40.426445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aedb5-a718-4de1-baa1-1d6d07a34b32 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:40.427838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 748/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:14:40.433737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e53bb-0f91-4376-8d9d-f6242e5f2a9d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:40.434321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e53bb-0f91-4376-8d9d-f6242e5f2a9d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:40.434321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e53bb-0f91-4376-8d9d-f6242e5f2a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:40.453442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-098e53bb-0f91-4376-8d9d-f6242e5f2a9d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:40.454783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-098e53bb-0f91-4376-8d9d-f6242e5f2a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:40.462956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 715/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:40.501850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aedb5-a718-4de1-baa1-1d6d07a34b32 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:40.513505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aedb5-a718-4de1-baa1-1d6d07a34b32 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:40.517272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14516051-2a18-4f3e-b6c8-07f3dd516e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:40.517927 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14516051-2a18-4f3e-b6c8-07f3dd516e43 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:40.518211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14516051-2a18-4f3e-b6c8-07f3dd516e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:40.518486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14516051-2a18-4f3e-b6c8-07f3dd516e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:40.528651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14516051-2a18-4f3e-b6c8-07f3dd516e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:40.530099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14516051-2a18-4f3e-b6c8-07f3dd516e43 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:40.541145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 749/1464] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:42.684519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867bf72-acd1-40f5-814b-da76d43bc5d2 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:42.685265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867bf72-acd1-40f5-814b-da76d43bc5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:42.685265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867bf72-acd1-40f5-814b-da76d43bc5d2 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:42.686741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 716/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:14:42.693054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d360-db92-41f4-9636-c154cde0c7a7 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:42.693744 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d360-db92-41f4-9636-c154cde0c7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:42.693744 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d360-db92-41f4-9636-c154cde0c7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:42.714066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-6e59d360-db92-41f4-9636-c154cde0c7a7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:42.715336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-6e59d360-db92-41f4-9636-c154cde0c7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:42.724349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 750/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:42.761661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867bf72-acd1-40f5-814b-da76d43bc5d2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:42.773465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867bf72-acd1-40f5-814b-da76d43bc5d2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:42.777190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a331c-732f-43b0-878b-657048a78157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:42.777843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a331c-732f-43b0-878b-657048a78157 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:42.778122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a331c-732f-43b0-878b-657048a78157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:42.778394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a331c-732f-43b0-878b-657048a78157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:42.788589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a331c-732f-43b0-878b-657048a78157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:42.790057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a331c-732f-43b0-878b-657048a78157 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:42.800957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 717/1467] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:44.916721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d6fc-da1c-4c36-b140-8a1d4f24ae5f None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:44.917304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d6fc-da1c-4c36-b140-8a1d4f24ae5f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:44.917568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d6fc-da1c-4c36-b140-8a1d4f24ae5f None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:44.919946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 751/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:44.929579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e140254-2cc0-46dd-b52e-fe46b2826c0b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:44.930155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e140254-2cc0-46dd-b52e-fe46b2826c0b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:44.930595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e140254-2cc0-46dd-b52e-fe46b2826c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:44.950327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7e140254-2cc0-46dd-b52e-fe46b2826c0b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:44.951580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7e140254-2cc0-46dd-b52e-fe46b2826c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:44.960491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 718/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:45.020289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422d6fc-da1c-4c36-b140-8a1d4f24ae5f None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:45.032880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422d6fc-da1c-4c36-b140-8a1d4f24ae5f None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:45.037309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582fe6-8a23-42e4-befa-8aa43cf88dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:45.037970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582fe6-8a23-42e4-befa-8aa43cf88dfd service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:45.038239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582fe6-8a23-42e4-befa-8aa43cf88dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:45.038527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582fe6-8a23-42e4-befa-8aa43cf88dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:45.049139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582fe6-8a23-42e4-befa-8aa43cf88dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:45.050710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582fe6-8a23-42e4-befa-8aa43cf88dfd service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:45.061696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 752/1470] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:14:54.944948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=17 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:55.056908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=17 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:05.794977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e253-68b2-4486-8427-4a7f77944cad None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:05.795702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e253-68b2-4486-8427-4a7f77944cad None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:05.795702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e253-68b2-4486-8427-4a7f77944cad None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:05.797251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 719/1471] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:05.804140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6c48-e47f-460d-b94b-df38722941f1 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:05.804748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6c48-e47f-460d-b94b-df38722941f1 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:05.804748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6c48-e47f-460d-b94b-df38722941f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:05.826405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-261d6c48-e47f-460d-b94b-df38722941f1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:05.827721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-261d6c48-e47f-460d-b94b-df38722941f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:05.837422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 753/1472] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:05.889310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d7760-aaea-4136-acd0-43fefc58ba07 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:05.889601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d7760-aaea-4136-acd0-43fefc58ba07 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:05.889855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d7760-aaea-4136-acd0-43fefc58ba07 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:05.891439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 720/1473] 10.222.0.66 () {54 vars in 962 bytes} [Wed Jun 22 10:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:05.897243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b0010-b4f3-4205-9882-27684b4bee58 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:05.897495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b0010-b4f3-4205-9882-27684b4bee58 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:05.897697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b0010-b4f3-4205-9882-27684b4bee58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:05.917926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-622b0010-b4f3-4205-9882-27684b4bee58 None None] MFA Rules not processed for user `e0055a33a380435d83a6d7384417c10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:05.919237 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-622b0010-b4f3-4205-9882-27684b4bee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:05.926390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 754/1474] 10.222.0.66 () {58 vars in 1059 bytes} [Wed Jun 22 10:15:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:05.934391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d7760-aaea-4136-acd0-43fefc58ba07 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:05.946929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d7760-aaea-4136-acd0-43fefc58ba07 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:05.951154 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd321f4f-ed71-4515-937c-1805a2fbe0b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0055a33a380435d83a6d7384417c10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:05.951911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd321f4f-ed71-4515-937c-1805a2fbe0b7 service glance] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:05.952276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd321f4f-ed71-4515-937c-1805a2fbe0b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:05.952669 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd321f4f-ed71-4515-937c-1805a2fbe0b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:05.963461 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd321f4f-ed71-4515-937c-1805a2fbe0b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:05.965776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd321f4f-ed71-4515-937c-1805a2fbe0b7 service glance] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:05.979001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 721/1475] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:08.146730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc05162-6bc9-47d6-a01e-89d3816c1778 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:08.147281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc05162-6bc9-47d6-a01e-89d3816c1778 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:08.147281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc05162-6bc9-47d6-a01e-89d3816c1778 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:08.148685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 755/1476] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:08.154733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38f2f-ca36-4dd8-b979-326a89399654 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:08.155204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38f2f-ca36-4dd8-b979-326a89399654 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:08.155318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38f2f-ca36-4dd8-b979-326a89399654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:08.174051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-35b38f2f-ca36-4dd8-b979-326a89399654 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:08.175313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-35b38f2f-ca36-4dd8-b979-326a89399654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:08.183461 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 722/1477] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:08.207399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc05162-6bc9-47d6-a01e-89d3816c1778 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:08.220814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc05162-6bc9-47d6-a01e-89d3816c1778 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:08.225557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81630834-5d79-45ae-bf0a-0caf29a954b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:08.226228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81630834-5d79-45ae-bf0a-0caf29a954b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:08.226521 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81630834-5d79-45ae-bf0a-0caf29a954b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:08.226813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81630834-5d79-45ae-bf0a-0caf29a954b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:08.227557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81630834-5d79-45ae-bf0a-0caf29a954b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:08.229385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WARNING py.warnings [None req-81630834-5d79-45ae-bf0a-0caf29a954b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:15:08.229385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: warnings.warn(msg) Jun 22 10:15:08.229385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: Jun 22 10:15:08.230544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81630834-5d79-45ae-bf0a-0caf29a954b6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:08.253144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 756/1478] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 10:15:08 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:10.368477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae824f-d777-4884-9856-e5c7b42661b4 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:10.369068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae824f-d777-4884-9856-e5c7b42661b4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:10.369068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae824f-d777-4884-9856-e5c7b42661b4 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:10.370430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 723/1479] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:10.376067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8968b88-a88b-4df6-8e8c-77a909b0e8c2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:10.376556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8968b88-a88b-4df6-8e8c-77a909b0e8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:10.376556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8968b88-a88b-4df6-8e8c-77a909b0e8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:10.397601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d8968b88-a88b-4df6-8e8c-77a909b0e8c2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:10.398857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d8968b88-a88b-4df6-8e8c-77a909b0e8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:10.408622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 757/1480] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:10.452017 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae824f-d777-4884-9856-e5c7b42661b4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:10.467887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae824f-d777-4884-9856-e5c7b42661b4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:10.474309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17de6b-f9a4-4aa1-ba24-7d0fba19b4a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:10.475005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17de6b-f9a4-4aa1-ba24-7d0fba19b4a8 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:10.475309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17de6b-f9a4-4aa1-ba24-7d0fba19b4a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:10.475572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17de6b-f9a4-4aa1-ba24-7d0fba19b4a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:10.484797 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17de6b-f9a4-4aa1-ba24-7d0fba19b4a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:10.486449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17de6b-f9a4-4aa1-ba24-7d0fba19b4a8 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:10.500946 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 724/1481] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:12.748874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd6df5-d7e8-4c2e-857f-2728888787c5 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:12.749514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd6df5-d7e8-4c2e-857f-2728888787c5 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:12.749514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd6df5-d7e8-4c2e-857f-2728888787c5 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:12.750909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 758/1482] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:12.756854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265c3e6-dd43-4525-b5b4-1ea84a3fba28 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:12.757404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265c3e6-dd43-4525-b5b4-1ea84a3fba28 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:12.757404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265c3e6-dd43-4525-b5b4-1ea84a3fba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:12.776661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8265c3e6-dd43-4525-b5b4-1ea84a3fba28 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:12.777864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8265c3e6-dd43-4525-b5b4-1ea84a3fba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:12.786540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 725/1483] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:12.822702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd6df5-d7e8-4c2e-857f-2728888787c5 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:12.834829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd6df5-d7e8-4c2e-857f-2728888787c5 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:12.838738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2d701-f6e7-465f-9f6a-519b0569c6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:12.839415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d701-f6e7-465f-9f6a-519b0569c6ed service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:12.839692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d701-f6e7-465f-9f6a-519b0569c6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:12.839963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d701-f6e7-465f-9f6a-519b0569c6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:12.855535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2d701-f6e7-465f-9f6a-519b0569c6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:12.858273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2d701-f6e7-465f-9f6a-519b0569c6ed service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:12.876801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 759/1484] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:15.002221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316050-da71-4a5e-bad5-ac13ed26c6d6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:15.002972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316050-da71-4a5e-bad5-ac13ed26c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:15.002972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316050-da71-4a5e-bad5-ac13ed26c6d6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:15.004225 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 726/1485] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:15.010444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acacc41-c11b-4537-9a75-c3644485ee0c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:15.011152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acacc41-c11b-4537-9a75-c3644485ee0c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:15.011152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acacc41-c11b-4537-9a75-c3644485ee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:15.031992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8acacc41-c11b-4537-9a75-c3644485ee0c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:15.033271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8acacc41-c11b-4537-9a75-c3644485ee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:15.042738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 760/1486] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:15.082100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316050-da71-4a5e-bad5-ac13ed26c6d6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:15.094276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316050-da71-4a5e-bad5-ac13ed26c6d6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:15.098381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5eb54-273a-44b7-a749-d4ddc92ea5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:15.099122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5eb54-273a-44b7-a749-d4ddc92ea5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:15.099437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5eb54-273a-44b7-a749-d4ddc92ea5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:15.099746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5eb54-273a-44b7-a749-d4ddc92ea5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:15.110593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5eb54-273a-44b7-a749-d4ddc92ea5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:15.112173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5eb54-273a-44b7-a749-d4ddc92ea5c3 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:15.124465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 727/1487] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:17.292616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c6b5f-ab3c-44de-ab26-58566f220603 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:17.293310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c6b5f-ab3c-44de-ab26-58566f220603 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:17.293310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c6b5f-ab3c-44de-ab26-58566f220603 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:17.294602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 761/1488] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:17.300561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083e27-d30e-4617-930c-65707fb748b1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:17.301407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083e27-d30e-4617-930c-65707fb748b1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:17.301598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083e27-d30e-4617-930c-65707fb748b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:17.321956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-94083e27-d30e-4617-930c-65707fb748b1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:17.323227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-94083e27-d30e-4617-930c-65707fb748b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:17.332709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 728/1489] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:17.375470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c6b5f-ab3c-44de-ab26-58566f220603 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:17.387261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c6b5f-ab3c-44de-ab26-58566f220603 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:17.391273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca364d-603e-42df-b192-d133829ea80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:17.391920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca364d-603e-42df-b192-d133829ea80c service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:17.392197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca364d-603e-42df-b192-d133829ea80c service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:17.392467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca364d-603e-42df-b192-d133829ea80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:17.402314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca364d-603e-42df-b192-d133829ea80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:17.403797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca364d-603e-42df-b192-d133829ea80c service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:17.414789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 762/1490] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:19.728706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ffd0c-3e7d-4732-825b-ba65fe97aadd None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:19.729333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ffd0c-3e7d-4732-825b-ba65fe97aadd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:19.729333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ffd0c-3e7d-4732-825b-ba65fe97aadd None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:19.730743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 729/1491] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 10:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:19.736433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f87c2-2c16-4a9c-a894-e41b4c8d0c2d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:19.736975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f87c2-2c16-4a9c-a894-e41b4c8d0c2d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:19.737073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f87c2-2c16-4a9c-a894-e41b4c8d0c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:19.758009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-563f87c2-2c16-4a9c-a894-e41b4c8d0c2d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:19.759370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-563f87c2-2c16-4a9c-a894-e41b4c8d0c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:19.768610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 763/1492] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 10:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:19.810305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ffd0c-3e7d-4732-825b-ba65fe97aadd None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:19.821708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ffd0c-3e7d-4732-825b-ba65fe97aadd None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:19.825430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b7ee5-b6c3-4732-a20a-df9cb9bcaf42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:19.826088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b7ee5-b6c3-4732-a20a-df9cb9bcaf42 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:19.826373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b7ee5-b6c3-4732-a20a-df9cb9bcaf42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:19.826695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b7ee5-b6c3-4732-a20a-df9cb9bcaf42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:19.837197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b7ee5-b6c3-4732-a20a-df9cb9bcaf42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:19.838708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b7ee5-b6c3-4732-a20a-df9cb9bcaf42 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:19.849291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 730/1493] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:29.750885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=33 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:29.844439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=33 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:45.297240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1bbdf-909d-4556-963d-a474610156a4 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.297880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1bbdf-909d-4556-963d-a474610156a4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.297880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1bbdf-909d-4556-963d-a474610156a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.316157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-92d1bbdf-909d-4556-963d-a474610156a4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:45.317353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-92d1bbdf-909d-4556-963d-a474610156a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:45.325914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 764/1494] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:45.335680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6168f4-d97c-4d6d-845e-7ec683c94dc4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.336246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6168f4-d97c-4d6d-845e-7ec683c94dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.336246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6168f4-d97c-4d6d-845e-7ec683c94dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.356973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7d6168f4-d97c-4d6d-845e-7ec683c94dc4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:45.358257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7d6168f4-d97c-4d6d-845e-7ec683c94dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:45.367856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 731/1495] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:45.372731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1bbdf-909d-4556-963d-a474610156a4 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:45.382885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1bbdf-909d-4556-963d-a474610156a4 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:45.388744 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7c922-fb05-4b1c-aa29-4a03d791bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:45.389526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7c922-fb05-4b1c-aa29-4a03d791bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.389816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7c922-fb05-4b1c-aa29-4a03d791bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.390097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7c922-fb05-4b1c-aa29-4a03d791bb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.390916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7c922-fb05-4b1c-aa29-4a03d791bb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:45.391227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7c922-fb05-4b1c-aa29-4a03d791bb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:45.392382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WARNING py.warnings [None req-9ab7c922-fb05-4b1c-aa29-4a03d791bb49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:45.392382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: warnings.warn(msg) Jun 22 10:16:45.392382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: Jun 22 10:16:45.393276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7c922-fb05-4b1c-aa29-4a03d791bb49 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:45.405806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 765/1496] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:16:45.414742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6168f4-d97c-4d6d-845e-7ec683c94dc4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:45.424317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6168f4-d97c-4d6d-845e-7ec683c94dc4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:45.429334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38486d28-6f76-42d1-9be5-51b11b1cac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:45.430004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38486d28-6f76-42d1-9be5-51b11b1cac14 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.430301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38486d28-6f76-42d1-9be5-51b11b1cac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.430621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38486d28-6f76-42d1-9be5-51b11b1cac14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.431341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38486d28-6f76-42d1-9be5-51b11b1cac14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:45.433193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: WARNING py.warnings [None req-38486d28-6f76-42d1-9be5-51b11b1cac14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:45.433193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: warnings.warn(msg) Jun 22 10:16:45.433193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: Jun 22 10:16:45.434409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38486d28-6f76-42d1-9be5-51b11b1cac14 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:45.474603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 732/1497] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:45 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:16:45.479029 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7c922-fb05-4b1c-aa29-4a03d791bb49 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:45.489766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7c922-fb05-4b1c-aa29-4a03d791bb49 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:45.548929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942e777-1162-48a5-b4c5-f40eb24c93b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:45.549511 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942e777-1162-48a5-b4c5-f40eb24c93b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.549794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942e777-1162-48a5-b4c5-f40eb24c93b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.550099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942e777-1162-48a5-b4c5-f40eb24c93b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.550783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942e777-1162-48a5-b4c5-f40eb24c93b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:45.551811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WARNING py.warnings [None req-7942e777-1162-48a5-b4c5-f40eb24c93b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:45.551811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: warnings.warn(msg) Jun 22 10:16:45.551811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: Jun 22 10:16:45.553039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942e777-1162-48a5-b4c5-f40eb24c93b2 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:45.575250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 766/1498] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:45 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:45.579826 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38486d28-6f76-42d1-9be5-51b11b1cac14 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:45.590950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38486d28-6f76-42d1-9be5-51b11b1cac14 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:45.596077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a038af-3b82-4b74-be41-103d947c069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:45.596776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a038af-3b82-4b74-be41-103d947c069d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.597058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a038af-3b82-4b74-be41-103d947c069d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.597330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a038af-3b82-4b74-be41-103d947c069d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.598060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a038af-3b82-4b74-be41-103d947c069d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:45.599118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: WARNING py.warnings [None req-f7a038af-3b82-4b74-be41-103d947c069d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:45.599118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: warnings.warn(msg) Jun 22 10:16:45.599118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: Jun 22 10:16:45.599991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a038af-3b82-4b74-be41-103d947c069d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:45.613033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 733/1499] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:45.617347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942e777-1162-48a5-b4c5-f40eb24c93b2 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:45.627796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942e777-1162-48a5-b4c5-f40eb24c93b2 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:45.632864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1df229-5ff4-4f3b-9a14-8aff50c9e309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:45.633532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1df229-5ff4-4f3b-9a14-8aff50c9e309 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.633811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1df229-5ff4-4f3b-9a14-8aff50c9e309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.634084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1df229-5ff4-4f3b-9a14-8aff50c9e309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.634850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1df229-5ff4-4f3b-9a14-8aff50c9e309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:45.635879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WARNING py.warnings [None req-3d1df229-5ff4-4f3b-9a14-8aff50c9e309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:45.635879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: warnings.warn(msg) Jun 22 10:16:45.635879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: Jun 22 10:16:45.636782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1df229-5ff4-4f3b-9a14-8aff50c9e309 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:45.651177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 767/1500] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:45.655640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a038af-3b82-4b74-be41-103d947c069d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:45.666367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a038af-3b82-4b74-be41-103d947c069d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:45.672557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e741b-8a18-45fd-a8c3-575ee4612f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:45.673457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e741b-8a18-45fd-a8c3-575ee4612f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.673728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e741b-8a18-45fd-a8c3-575ee4612f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.674004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e741b-8a18-45fd-a8c3-575ee4612f17 admin admin] PATH_INFO: `/v3/projects/6f2770ae6b354b5d94e0088731ad96ff/users/1fec0d793d8c4971b88b0fb9b70d8f88/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.689749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e741b-8a18-45fd-a8c3-575ee4612f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2770ae6b354b5d94e0088731ad96ff, user_id=1fec0d793d8c4971b88b0fb9b70d8f88, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:45.690864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: WARNING py.warnings [None req-3f8e741b-8a18-45fd-a8c3-575ee4612f17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:45.690864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: warnings.warn(msg) Jun 22 10:16:45.690864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: Jun 22 10:16:45.692822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e741b-8a18-45fd-a8c3-575ee4612f17 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:45.707787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 734/1501] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:45 2022] PUT /identity/v3/projects/6f2770ae6b354b5d94e0088731ad96ff/users/1fec0d793d8c4971b88b0fb9b70d8f88/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:45.719382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2696e0-a1f6-4a92-9cc5-10c6c5aad523 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.719678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2696e0-a1f6-4a92-9cc5-10c6c5aad523 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.719955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2696e0-a1f6-4a92-9cc5-10c6c5aad523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.747563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-ef2696e0-a1f6-4a92-9cc5-10c6c5aad523 None None] MFA Rules not processed for user `1fec0d793d8c4971b88b0fb9b70d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:45.748879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ef2696e0-a1f6-4a92-9cc5-10c6c5aad523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:45.818851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 768/1502] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:45.832754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e31fe1-985d-4d88-b9fa-f82d1c7eb368 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.833015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e31fe1-985d-4d88-b9fa-f82d1c7eb368 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.833326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e31fe1-985d-4d88-b9fa-f82d1c7eb368 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.834764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 735/1503] 10.222.0.66 () {54 vars in 963 bytes} [Wed Jun 22 10:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:45.840280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828011-c5ed-4b55-a1fb-bdb64a02e28e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.840565 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828011-c5ed-4b55-a1fb-bdb64a02e28e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.840850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828011-c5ed-4b55-a1fb-bdb64a02e28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.861178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-bd828011-c5ed-4b55-a1fb-bdb64a02e28e None None] MFA Rules not processed for user `3748ece05182480f90a70dc587f2a007`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:45.862402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-bd828011-c5ed-4b55-a1fb-bdb64a02e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:45.910645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:45.920011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 769/1504] 10.222.0.66 () {58 vars in 1060 bytes} [Wed Jun 22 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:45.927743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e31fe1-985d-4d88-b9fa-f82d1c7eb368 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:45.940261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e31fe1-985d-4d88-b9fa-f82d1c7eb368 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:45.944246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00d4a2-46f3-4560-b83d-7c35e65c9275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:45.944905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00d4a2-46f3-4560-b83d-7c35e65c9275 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.945190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00d4a2-46f3-4560-b83d-7c35e65c9275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.945461 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00d4a2-46f3-4560-b83d-7c35e65c9275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.954374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00d4a2-46f3-4560-b83d-7c35e65c9275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:45.955860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00d4a2-46f3-4560-b83d-7c35e65c9275 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:45.965327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 736/1505] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:46.007803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2ed4d-a690-405b-978a-b70c452d77ea None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:46.008088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2ed4d-a690-405b-978a-b70c452d77ea None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:46.008376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2ed4d-a690-405b-978a-b70c452d77ea None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:46.009654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 770/1506] 10.222.0.66 () {52 vars in 829 bytes} [Wed Jun 22 10:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:46.013521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00d4a2-46f3-4560-b83d-7c35e65c9275 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:46.079835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00d4a2-46f3-4560-b83d-7c35e65c9275 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:46.084429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:46.085321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:46.085605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:46.085881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] PATH_INFO: `/v3/users/1fec0d793d8c4971b88b0fb9b70d8f88` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:46.087182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fec0d793d8c4971b88b0fb9b70d8f88)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:46.088223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: WARNING py.warnings [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:46.088223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: warnings.warn(msg) Jun 22 10:16:46.088223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: Jun 22 10:16:46.089454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:46.163950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fec0d793d8c4971b88b0fb9b70d8f88'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:46.180495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fec0d793d8c4971b88b0fb9b70d8f88'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:46.181190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fec0d793d8c4971b88b0fb9b70d8f88'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:46.205090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fec0d793d8c4971b88b0fb9b70d8f88'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:46.214085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:46.219763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fec0d793d8c4971b88b0fb9b70d8f88'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:46.227559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 737/1507] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:46 2022] DELETE /identity/v3/users/1fec0d793d8c4971b88b0fb9b70d8f88 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:46.232094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc4b3a-d254-443e-880b-3f37dee68182 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:46.232385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc4b3a-d254-443e-880b-3f37dee68182 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:46.232648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc4b3a-d254-443e-880b-3f37dee68182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:46.250765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-95bc4b3a-d254-443e-880b-3f37dee68182 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:46.251965 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-95bc4b3a-d254-443e-880b-3f37dee68182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:46.312489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 771/1508] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:46.323093 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:46.324822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:46.385336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065648ac-d573-4499-8d7f-21954fdf5f85 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:46.389506 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f96aed-6419-47a0-9e81-43163a10d197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:46.390197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f96aed-6419-47a0-9e81-43163a10d197 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:46.390478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f96aed-6419-47a0-9e81-43163a10d197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:46.390779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f96aed-6419-47a0-9e81-43163a10d197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:46.400539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f96aed-6419-47a0-9e81-43163a10d197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:46.401983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f96aed-6419-47a0-9e81-43163a10d197 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:46.412153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 738/1509] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:46.824284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc4b3a-d254-443e-880b-3f37dee68182 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:46.825719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-95bc4b3a-d254-443e-880b-3f37dee68182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:46.842138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc4b3a-d254-443e-880b-3f37dee68182 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:46.849571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:46.850481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:46.850801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:46.851073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] PATH_INFO: `/v3/projects/6f2770ae6b354b5d94e0088731ad96ff` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:46.852389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2770ae6b354b5d94e0088731ad96ff)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:46.853443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WARNING py.warnings [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:46.853443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: warnings.warn(msg) Jun 22 10:16:46.853443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: Jun 22 10:16:46.854713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:46.917995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2770ae6b354b5d94e0088731ad96ff', 'request_id': 'req-8796a9ab-1b09-4b28-8856-8cd780cad0b2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:46.928092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2770ae6b354b5d94e0088731ad96ff', 'request_id': 'req-8796a9ab-1b09-4b28-8856-8cd780cad0b2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:46.942231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2770ae6b354b5d94e0088731ad96ff', 'request_id': 'req-8796a9ab-1b09-4b28-8856-8cd780cad0b2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:46.954960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] The token cache is being invalidate because project 6f2770ae6b354b5d94e0088731ad96ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:46.955245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:46.956084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8796a9ab-1b09-4b28-8856-8cd780cad0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:46.957779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 772/1510] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:46 2022] DELETE /identity/v3/projects/6f2770ae6b354b5d94e0088731ad96ff => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:56.407811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=29 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:56.951243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:28.429549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611612dd-ee4e-4d8b-8923-9768b7f650a6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:28.430155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611612dd-ee4e-4d8b-8923-9768b7f650a6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:28.430155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611612dd-ee4e-4d8b-8923-9768b7f650a6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:28.431479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 739/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:28.437899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e010e12-e886-486e-a305-c624bd4342b1 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:28.437899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e010e12-e886-486e-a305-c624bd4342b1 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:28.438418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e010e12-e886-486e-a305-c624bd4342b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:28.457295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8e010e12-e886-486e-a305-c624bd4342b1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:28.458566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8e010e12-e886-486e-a305-c624bd4342b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:28.525252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 773/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:28.678814 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611612dd-ee4e-4d8b-8923-9768b7f650a6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:28.680935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-611612dd-ee4e-4d8b-8923-9768b7f650a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:28.760231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611612dd-ee4e-4d8b-8923-9768b7f650a6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:28.766159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee2e32-1076-4848-8a91-1a8818711c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:28.766846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee2e32-1076-4848-8a91-1a8818711c99 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:28.767140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee2e32-1076-4848-8a91-1a8818711c99 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:28.767416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee2e32-1076-4848-8a91-1a8818711c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:28.776093 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee2e32-1076-4848-8a91-1a8818711c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:28.777693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee2e32-1076-4848-8a91-1a8818711c99 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:28.788074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 740/1513] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:29.621423 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d591b-6e6e-4b7b-8075-92e7df9857cd None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:29.622125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d591b-6e6e-4b7b-8075-92e7df9857cd None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:29.622125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d591b-6e6e-4b7b-8075-92e7df9857cd None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:29.623625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 774/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:29.629254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbdaf3-29a2-434f-a306-d47082a8a2f1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:29.629873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbdaf3-29a2-434f-a306-d47082a8a2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:29.629873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbdaf3-29a2-434f-a306-d47082a8a2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:29.650086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c7fbdaf3-29a2-434f-a306-d47082a8a2f1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:29.651381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c7fbdaf3-29a2-434f-a306-d47082a8a2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:29.660504 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 741/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:29.816052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d591b-6e6e-4b7b-8075-92e7df9857cd None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:29.831695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d591b-6e6e-4b7b-8075-92e7df9857cd None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:29.839704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664a126-bc76-48e2-9c2a-c497946cd97a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:29.840392 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a126-bc76-48e2-9c2a-c497946cd97a service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:29.840670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a126-bc76-48e2-9c2a-c497946cd97a service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:29.840940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a126-bc76-48e2-9c2a-c497946cd97a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:29.850075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664a126-bc76-48e2-9c2a-c497946cd97a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:29.851846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664a126-bc76-48e2-9c2a-c497946cd97a service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:29.867080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 775/1516] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:31.940912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f729d7d-e923-47e1-9f24-a82dcec3be42 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:31.942460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f729d7d-e923-47e1-9f24-a82dcec3be42 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:31.942773 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f729d7d-e923-47e1-9f24-a82dcec3be42 None None] PATH_INFO: `/v3` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:31.944173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 742/1517] 10.222.0.36 () {54 vars in 925 bytes} [Wed Jun 22 10:18:31 2022] GET /identity/v3 => generated 255 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:31.951117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024983ac-9477-4a9e-8cdc-bbb52cce3a51 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:31.951798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024983ac-9477-4a9e-8cdc-bbb52cce3a51 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:31.951798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024983ac-9477-4a9e-8cdc-bbb52cce3a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:31.971292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-024983ac-9477-4a9e-8cdc-bbb52cce3a51 None None] MFA Rules not processed for user `9b257dee0ca3400f860ef9bd8c7a4e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:31.972526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-024983ac-9477-4a9e-8cdc-bbb52cce3a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:32.044005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 776/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Jun 22 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:36.069042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457b916-300b-4fc7-b5f4-6f4a547deb90 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:36.069904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457b916-300b-4fc7-b5f4-6f4a547deb90 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:36.070067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457b916-300b-4fc7-b5f4-6f4a547deb90 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:36.071686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 743/1519] 10.222.0.66 () {54 vars in 960 bytes} [Wed Jun 22 10:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:36.077268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ed69-d0d5-4d40-bece-2017a51d92bf None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:36.077801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ed69-d0d5-4d40-bece-2017a51d92bf None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:36.077901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ed69-d0d5-4d40-bece-2017a51d92bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:36.099058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-abf7ed69-d0d5-4d40-bece-2017a51d92bf None None] MFA Rules not processed for user `9b257dee0ca3400f860ef9bd8c7a4e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:36.100316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-abf7ed69-d0d5-4d40-bece-2017a51d92bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:36.110864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 777/1520] 10.222.0.66 () {58 vars in 1057 bytes} [Wed Jun 22 10:18:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:36.118776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457b916-300b-4fc7-b5f4-6f4a547deb90 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:36.134493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457b916-300b-4fc7-b5f4-6f4a547deb90 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:36.140326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69dd0b-eae3-4a64-9577-f5b050bb1981 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:36.141020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69dd0b-eae3-4a64-9577-f5b050bb1981 service placement] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:36.141345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69dd0b-eae3-4a64-9577-f5b050bb1981 service placement] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:36.141666 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69dd0b-eae3-4a64-9577-f5b050bb1981 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:36.151368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69dd0b-eae3-4a64-9577-f5b050bb1981 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:36.153102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69dd0b-eae3-4a64-9577-f5b050bb1981 service placement] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:36.163982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 744/1521] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:41.122423 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a527-6a66-4d75-81b3-cb0366709e49 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.123142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a527-6a66-4d75-81b3-cb0366709e49 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.123142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a527-6a66-4d75-81b3-cb0366709e49 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.124570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 778/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:41.130165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e50f03-0e33-4d14-a0ac-6b1e497680c4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.130844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e50f03-0e33-4d14-a0ac-6b1e497680c4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.130991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e50f03-0e33-4d14-a0ac-6b1e497680c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.151002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d8e50f03-0e33-4d14-a0ac-6b1e497680c4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:41.152275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d8e50f03-0e33-4d14-a0ac-6b1e497680c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:41.162834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 745/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:41.318889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984a527-6a66-4d75-81b3-cb0366709e49 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:41.335967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984a527-6a66-4d75-81b3-cb0366709e49 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:41.342800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd3b30-50be-43cb-a7c0-e341b40aa584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:41.343686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3b30-50be-43cb-a7c0-e341b40aa584 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.344083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3b30-50be-43cb-a7c0-e341b40aa584 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.344464 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3b30-50be-43cb-a7c0-e341b40aa584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.354820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd3b30-50be-43cb-a7c0-e341b40aa584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:41.356770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd3b30-50be-43cb-a7c0-e341b40aa584 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:41.371439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 779/1524] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:42.243184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646e227-3c5f-4334-88ad-88cb3172050f None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:42.244070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646e227-3c5f-4334-88ad-88cb3172050f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:42.244070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646e227-3c5f-4334-88ad-88cb3172050f None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:42.245857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 746/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:42.251370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3bc95-0fb1-4bab-afe9-aac48c223f02 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:42.252130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3bc95-0fb1-4bab-afe9-aac48c223f02 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:42.252320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3bc95-0fb1-4bab-afe9-aac48c223f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:42.274205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-cba3bc95-0fb1-4bab-afe9-aac48c223f02 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:42.275692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cba3bc95-0fb1-4bab-afe9-aac48c223f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:42.285767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 780/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:42.442485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646e227-3c5f-4334-88ad-88cb3172050f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:42.460672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646e227-3c5f-4334-88ad-88cb3172050f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:42.467104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7b8a7-bee3-479d-9569-1e7ecca08c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:42.467943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b8a7-bee3-479d-9569-1e7ecca08c65 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:42.468224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b8a7-bee3-479d-9569-1e7ecca08c65 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:42.468501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b8a7-bee3-479d-9569-1e7ecca08c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:42.478457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7b8a7-bee3-479d-9569-1e7ecca08c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:42.480129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7b8a7-bee3-479d-9569-1e7ecca08c65 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:42.491794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 747/1527] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:46.727511 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c188-8081-4812-8e06-fce8bdfe96f3 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:46.728107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c188-8081-4812-8e06-fce8bdfe96f3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:46.728107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c188-8081-4812-8e06-fce8bdfe96f3 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:46.729657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 781/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:46.736432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151323f-991a-4915-a928-fe3a25fe18f4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:46.737024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151323f-991a-4915-a928-fe3a25fe18f4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:46.737024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151323f-991a-4915-a928-fe3a25fe18f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:46.757141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0151323f-991a-4915-a928-fe3a25fe18f4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:46.758380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0151323f-991a-4915-a928-fe3a25fe18f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:46.767421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 748/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:46.806954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9c188-8081-4812-8e06-fce8bdfe96f3 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:46.808937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-6fd9c188-8081-4812-8e06-fce8bdfe96f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:46.876049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9c188-8081-4812-8e06-fce8bdfe96f3 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:46.880214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb335cc5-2ca8-4393-90e7-c53c605ffc8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:46.881024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb335cc5-2ca8-4393-90e7-c53c605ffc8e service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:46.881326 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb335cc5-2ca8-4393-90e7-c53c605ffc8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:46.881602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb335cc5-2ca8-4393-90e7-c53c605ffc8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:46.891705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb335cc5-2ca8-4393-90e7-c53c605ffc8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:46.896342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb335cc5-2ca8-4393-90e7-c53c605ffc8e service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:46.901823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:46.908407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 782/1530] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:48.988402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a1cad-fcee-4bfd-a0f4-f6f21a035e60 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:48.989029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a1cad-fcee-4bfd-a0f4-f6f21a035e60 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:48.989029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a1cad-fcee-4bfd-a0f4-f6f21a035e60 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:48.990323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 749/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:48.996165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b14d-aeed-4722-91a8-27446dd0901b None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:48.996711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b14d-aeed-4722-91a8-27446dd0901b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:48.996711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b14d-aeed-4722-91a8-27446dd0901b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:49.015740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-f910b14d-aeed-4722-91a8-27446dd0901b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:49.016982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f910b14d-aeed-4722-91a8-27446dd0901b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:49.025389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 783/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:49.063681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a1cad-fcee-4bfd-a0f4-f6f21a035e60 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:49.065673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c16a1cad-fcee-4bfd-a0f4-f6f21a035e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:49.081185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a1cad-fcee-4bfd-a0f4-f6f21a035e60 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:49.085236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ead98-49b0-4655-85e0-537edde4df12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:49.085928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ead98-49b0-4655-85e0-537edde4df12 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:49.086258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ead98-49b0-4655-85e0-537edde4df12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:49.086636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ead98-49b0-4655-85e0-537edde4df12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:49.097687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ead98-49b0-4655-85e0-537edde4df12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:49.099162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ead98-49b0-4655-85e0-537edde4df12 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:49.109352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 750/1533] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:52.643656 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf9b79-b8c9-4184-b0a4-ef97be8ced3b None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:52.644445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf9b79-b8c9-4184-b0a4-ef97be8ced3b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:52.644445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf9b79-b8c9-4184-b0a4-ef97be8ced3b None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:52.645603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 784/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:52.651216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26654a9-1df2-4e62-8b8e-c976e589dde6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:52.651742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26654a9-1df2-4e62-8b8e-c976e589dde6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:52.651742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26654a9-1df2-4e62-8b8e-c976e589dde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:52.672626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c26654a9-1df2-4e62-8b8e-c976e589dde6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:52.673858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c26654a9-1df2-4e62-8b8e-c976e589dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:52.682336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 751/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:52.990520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf9b79-b8c9-4184-b0a4-ef97be8ced3b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:52.992841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4abf9b79-b8c9-4184-b0a4-ef97be8ced3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:53.055295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf9b79-b8c9-4184-b0a4-ef97be8ced3b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:53.059429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7158b-a5de-4686-b026-3a861b493c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:53.060080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7158b-a5de-4686-b026-3a861b493c55 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:53.060358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7158b-a5de-4686-b026-3a861b493c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:53.060630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7158b-a5de-4686-b026-3a861b493c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:53.070209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7158b-a5de-4686-b026-3a861b493c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:53.071694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7158b-a5de-4686-b026-3a861b493c55 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:53.081869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 785/1536] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:55.146763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775c89a-2d95-4569-86e0-299474d826c5 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:55.147340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775c89a-2d95-4569-86e0-299474d826c5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:55.147340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775c89a-2d95-4569-86e0-299474d826c5 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:55.148653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 752/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:55.154258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17114b47-95b8-44b9-ba35-f14fd4489aef None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:55.154701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17114b47-95b8-44b9-ba35-f14fd4489aef None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:55.154855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17114b47-95b8-44b9-ba35-f14fd4489aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:55.174870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-17114b47-95b8-44b9-ba35-f14fd4489aef None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:55.176085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-17114b47-95b8-44b9-ba35-f14fd4489aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:55.185636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 786/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:55.492003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775c89a-2d95-4569-86e0-299474d826c5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:55.494122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0775c89a-2d95-4569-86e0-299474d826c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:55.509196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775c89a-2d95-4569-86e0-299474d826c5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:55.515454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4b803-22b3-4736-8ff9-417e0f1b0c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:55.516171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4b803-22b3-4736-8ff9-417e0f1b0c96 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:55.516453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4b803-22b3-4736-8ff9-417e0f1b0c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:55.516770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4b803-22b3-4736-8ff9-417e0f1b0c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:55.527329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4b803-22b3-4736-8ff9-417e0f1b0c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:55.528799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4b803-22b3-4736-8ff9-417e0f1b0c96 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:55.539722 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 753/1539] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:05.169225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=32 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:05.535106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=70 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:27.730078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041952b0-471c-4388-ac76-efe8e929ba74 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:27.730858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041952b0-471c-4388-ac76-efe8e929ba74 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:27.730858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041952b0-471c-4388-ac76-efe8e929ba74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:27.756076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-041952b0-471c-4388-ac76-efe8e929ba74 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:27.757323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-041952b0-471c-4388-ac76-efe8e929ba74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:27.766425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 787/1540] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:27.777981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df593169-b0df-4044-b04e-56fdaa6f56ca None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:27.778630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df593169-b0df-4044-b04e-56fdaa6f56ca None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:27.778630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df593169-b0df-4044-b04e-56fdaa6f56ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:27.809460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-df593169-b0df-4044-b04e-56fdaa6f56ca None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:27.811048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-df593169-b0df-4044-b04e-56fdaa6f56ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:27.825568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 754/1541] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:27.830469 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041952b0-471c-4388-ac76-efe8e929ba74 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:27.844735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041952b0-471c-4388-ac76-efe8e929ba74 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:27.849421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcd16b-d42d-4b03-b2fc-076d7f0ba637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:27.850110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd16b-d42d-4b03-b2fc-076d7f0ba637 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:27.850394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd16b-d42d-4b03-b2fc-076d7f0ba637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:27.859125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd16b-d42d-4b03-b2fc-076d7f0ba637 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:27.860043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcd16b-d42d-4b03-b2fc-076d7f0ba637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:27.860366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcd16b-d42d-4b03-b2fc-076d7f0ba637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:27.862035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcd16b-d42d-4b03-b2fc-076d7f0ba637 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:27.877147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 788/1542] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:27.885725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df593169-b0df-4044-b04e-56fdaa6f56ca None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:27.895971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df593169-b0df-4044-b04e-56fdaa6f56ca None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:27.909720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33193efa-b969-422d-9865-5346c5314275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:27.910417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193efa-b969-422d-9865-5346c5314275 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:27.910729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193efa-b969-422d-9865-5346c5314275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:27.911003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193efa-b969-422d-9865-5346c5314275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:27.911725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33193efa-b969-422d-9865-5346c5314275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:27.913874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33193efa-b969-422d-9865-5346c5314275 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:27.963659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 755/1543] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:27 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:27.967901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcd16b-d42d-4b03-b2fc-076d7f0ba637 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:27.986427 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcd16b-d42d-4b03-b2fc-076d7f0ba637 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.063948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b4263-7f2b-494c-a531-fc4c87abafd4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.064307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b4263-7f2b-494c-a531-fc4c87abafd4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.064495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b4263-7f2b-494c-a531-fc4c87abafd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.066331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ae64-26ca-4164-82e1-0fdec7f49b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.067056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ae64-26ca-4164-82e1-0fdec7f49b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.067342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ae64-26ca-4164-82e1-0fdec7f49b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.067622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ae64-26ca-4164-82e1-0fdec7f49b23 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.068329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ae64-26ca-4164-82e1-0fdec7f49b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.070351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ae64-26ca-4164-82e1-0fdec7f49b23 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.103377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4b8b4263-7f2b-494c-a531-fc4c87abafd4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.104711 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4b8b4263-7f2b-494c-a531-fc4c87abafd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.106287 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 789/1544] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:27 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:28.110233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ae64-26ca-4164-82e1-0fdec7f49b23 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.123450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 756/1545] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:28.126366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ae64-26ca-4164-82e1-0fdec7f49b23 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.139546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c08d-ab84-44cc-912d-e7041d4d31eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.140250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c08d-ab84-44cc-912d-e7041d4d31eb admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.140537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c08d-ab84-44cc-912d-e7041d4d31eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.140810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c08d-ab84-44cc-912d-e7041d4d31eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.141556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8c08d-ab84-44cc-912d-e7041d4d31eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.143272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8c08d-ab84-44cc-912d-e7041d4d31eb admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.144724 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd3562-d283-44d5-b448-c29d7a6221b7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.145026 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd3562-d283-44d5-b448-c29d7a6221b7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.145302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd3562-d283-44d5-b448-c29d7a6221b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.170721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 790/1546] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:28.175104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c08d-ab84-44cc-912d-e7041d4d31eb admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.187841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-42dd3562-d283-44d5-b448-c29d7a6221b7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.189066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-42dd3562-d283-44d5-b448-c29d7a6221b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.197556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c08d-ab84-44cc-912d-e7041d4d31eb admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.202570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f489752-746b-4355-a46c-ab6747416a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.203372 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f489752-746b-4355-a46c-ab6747416a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.203753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f489752-746b-4355-a46c-ab6747416a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.204042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f489752-746b-4355-a46c-ab6747416a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.204778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f489752-746b-4355-a46c-ab6747416a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.206413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f489752-746b-4355-a46c-ab6747416a3a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.218832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 757/1547] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.223246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd3562-d283-44d5-b448-c29d7a6221b7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.225985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 791/1548] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:28.229703 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f489752-746b-4355-a46c-ab6747416a3a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.242110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd3562-d283-44d5-b448-c29d7a6221b7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.247407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f489752-746b-4355-a46c-ab6747416a3a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.257423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff1f48-132f-4459-83a3-aa16b858a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.258899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff1f48-132f-4459-83a3-aa16b858a046 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.259182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff1f48-132f-4459-83a3-aa16b858a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.259454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff1f48-132f-4459-83a3-aa16b858a046 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.260409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff1f48-132f-4459-83a3-aa16b858a046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:28.260718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff1f48-132f-4459-83a3-aa16b858a046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.261757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: WARNING py.warnings [None req-b0ff1f48-132f-4459-83a3-aa16b858a046 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:20:28.261757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: warnings.warn(msg) Jun 22 10:20:28.261757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: Jun 22 10:20:28.262697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff1f48-132f-4459-83a3-aa16b858a046 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.266467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c9a7a-e874-44a7-bc36-e838b9cf3474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.267548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c9a7a-e874-44a7-bc36-e838b9cf3474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.267958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c9a7a-e874-44a7-bc36-e838b9cf3474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.268252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c9a7a-e874-44a7-bc36-e838b9cf3474 admin admin] PATH_INFO: `/v3/projects/3e253dfe684b469383c18ff8c2a3dbd9/users/96d2a62272e248d3b11aca8737e22fb2/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.296396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 758/1549] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:20:28.297834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725444c0-2f32-44de-b6e1-0634aca6821b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.298122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725444c0-2f32-44de-b6e1-0634aca6821b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.298397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725444c0-2f32-44de-b6e1-0634aca6821b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.300023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c9a7a-e874-44a7-bc36-e838b9cf3474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e253dfe684b469383c18ff8c2a3dbd9, user_id=96d2a62272e248d3b11aca8737e22fb2, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.301519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WARNING py.warnings [None req-832c9a7a-e874-44a7-bc36-e838b9cf3474 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:20:28.301519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: warnings.warn(msg) Jun 22 10:20:28.301519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: Jun 22 10:20:28.303894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c9a7a-e874-44a7-bc36-e838b9cf3474 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.318392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-725444c0-2f32-44de-b6e1-0634aca6821b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.319611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-725444c0-2f32-44de-b6e1-0634aca6821b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.320099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 792/1550] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:28 2022] PUT /identity/v3/projects/3e253dfe684b469383c18ff8c2a3dbd9/users/96d2a62272e248d3b11aca8737e22fb2/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:28.321844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316adb-6e3d-418f-a639-f3c717700a91 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.322137 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316adb-6e3d-418f-a639-f3c717700a91 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.322439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316adb-6e3d-418f-a639-f3c717700a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.341098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-1a316adb-6e3d-418f-a639-f3c717700a91 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.342322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1a316adb-6e3d-418f-a639-f3c717700a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.390675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 759/1551] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.392282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca20c0a-b4ae-4fe7-b2d6-51cb75018336 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.392737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca20c0a-b4ae-4fe7-b2d6-51cb75018336 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.393013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca20c0a-b4ae-4fe7-b2d6-51cb75018336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.412907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0ca20c0a-b4ae-4fe7-b2d6-51cb75018336 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.414228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0ca20c0a-b4ae-4fe7-b2d6-51cb75018336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.417586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 793/1552] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.418999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1084d2-cf4d-4fd8-8708-c21b34eadd01 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.419283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1084d2-cf4d-4fd8-8708-c21b34eadd01 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.419560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1084d2-cf4d-4fd8-8708-c21b34eadd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.423555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 760/1553] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.424780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b4bb-72c1-4d6c-b157-5ff396cf0808 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.425169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b4bb-72c1-4d6c-b157-5ff396cf0808 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.425547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b4bb-72c1-4d6c-b157-5ff396cf0808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.442545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-1a1084d2-cf4d-4fd8-8708-c21b34eadd01 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.444151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1a1084d2-cf4d-4fd8-8708-c21b34eadd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.445986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b853b4bb-72c1-4d6c-b157-5ff396cf0808 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.447260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b853b4bb-72c1-4d6c-b157-5ff396cf0808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.451916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 794/1554] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.452736 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1084d2-cf4d-4fd8-8708-c21b34eadd01 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.461073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 761/1555] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.462288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1084d2-cf4d-4fd8-8708-c21b34eadd01 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.462412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab77c9-f5de-4b17-b838-9875a446c6e4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.462676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab77c9-f5de-4b17-b838-9875a446c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.462958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab77c9-f5de-4b17-b838-9875a446c6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.472180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b8486-0075-4d53-82b5-71aee188529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.472854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b8486-0075-4d53-82b5-71aee188529b admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.473135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b8486-0075-4d53-82b5-71aee188529b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.473408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b8486-0075-4d53-82b5-71aee188529b admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.474139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b8486-0075-4d53-82b5-71aee188529b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.475204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WARNING py.warnings [None req-7c4b8486-0075-4d53-82b5-71aee188529b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:20:28.475204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: warnings.warn(msg) Jun 22 10:20:28.475204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: Jun 22 10:20:28.476467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b8486-0075-4d53-82b5-71aee188529b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.482535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-41ab77c9-f5de-4b17-b838-9875a446c6e4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.483794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-41ab77c9-f5de-4b17-b838-9875a446c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.491037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:28.492052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 762/1556] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.493096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009ac79-749a-41b3-bc0c-a12a2df0876b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.493395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009ac79-749a-41b3-bc0c-a12a2df0876b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.493722 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009ac79-749a-41b3-bc0c-a12a2df0876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.515358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 795/1557] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:28.515358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736904fa-7461-4943-a411-9d30fd22f913 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.515358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736904fa-7461-4943-a411-9d30fd22f913 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.515358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736904fa-7461-4943-a411-9d30fd22f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.515943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4009ac79-749a-41b3-bc0c-a12a2df0876b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.517135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4009ac79-749a-41b3-bc0c-a12a2df0876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.533601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-736904fa-7461-4943-a411-9d30fd22f913 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.534977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-736904fa-7461-4943-a411-9d30fd22f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.578707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 763/1558] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.580188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca54390-e5ed-4633-851c-f4afab00c697 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.580529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca54390-e5ed-4633-851c-f4afab00c697 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.580854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca54390-e5ed-4633-851c-f4afab00c697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.602532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-aca54390-e5ed-4633-851c-f4afab00c697 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.603915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-aca54390-e5ed-4633-851c-f4afab00c697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.610420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 796/1559] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.611780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f680-e5c6-4c40-bb08-d0b46a26f2b4 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.612071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f680-e5c6-4c40-bb08-d0b46a26f2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.612350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f680-e5c6-4c40-bb08-d0b46a26f2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.612548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 764/1560] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.614086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6308f-54d7-4c79-a9b5-91d1129a79d2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.614579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6308f-54d7-4c79-a9b5-91d1129a79d2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.614892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6308f-54d7-4c79-a9b5-91d1129a79d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.633118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-75e6308f-54d7-4c79-a9b5-91d1129a79d2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.634312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-75e6308f-54d7-4c79-a9b5-91d1129a79d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.635364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c635f680-e5c6-4c40-bb08-d0b46a26f2b4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.636561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c635f680-e5c6-4c40-bb08-d0b46a26f2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.642546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 765/1561] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.643922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c476bd-b0a6-4f41-8428-abd945b68c8d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.644200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c476bd-b0a6-4f41-8428-abd945b68c8d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.644507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c476bd-b0a6-4f41-8428-abd945b68c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.645396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 797/1562] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.647273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f26be6-46cf-4310-9e17-dbf93bab2314 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.647678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f26be6-46cf-4310-9e17-dbf93bab2314 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.648076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f26be6-46cf-4310-9e17-dbf93bab2314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.666953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-f5f26be6-46cf-4310-9e17-dbf93bab2314 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.667367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d0c476bd-b0a6-4f41-8428-abd945b68c8d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:28.668175 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f5f26be6-46cf-4310-9e17-dbf93bab2314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.668526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d0c476bd-b0a6-4f41-8428-abd945b68c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:28.676309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 766/1563] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.676465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 798/1564] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:28.677123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c476bd-b0a6-4f41-8428-abd945b68c8d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.680719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f26be6-46cf-4310-9e17-dbf93bab2314 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.687224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c476bd-b0a6-4f41-8428-abd945b68c8d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.691730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0db8-03eb-409d-82f3-d04e81b12eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.692396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0db8-03eb-409d-82f3-d04e81b12eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.692677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0db8-03eb-409d-82f3-d04e81b12eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.692949 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0db8-03eb-409d-82f3-d04e81b12eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.693634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b0db8-03eb-409d-82f3-d04e81b12eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.694683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: WARNING py.warnings [None req-b27b0db8-03eb-409d-82f3-d04e81b12eb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:20:28.694683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: warnings.warn(msg) Jun 22 10:20:28.694683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: Jun 22 10:20:28.695902 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b0db8-03eb-409d-82f3-d04e81b12eb1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.703393 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:28.722964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 767/1565] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:28.722964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0db8-03eb-409d-82f3-d04e81b12eb1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.731700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0db8-03eb-409d-82f3-d04e81b12eb1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.736835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8f4c4-1df7-4d10-a9f2-61639202d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.737580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8f4c4-1df7-4d10-a9f2-61639202d8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.738010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8f4c4-1df7-4d10-a9f2-61639202d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.738298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8f4c4-1df7-4d10-a9f2-61639202d8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.739080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8f4c4-1df7-4d10-a9f2-61639202d8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:28.739394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8f4c4-1df7-4d10-a9f2-61639202d8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.741028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8f4c4-1df7-4d10-a9f2-61639202d8a3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.744954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f26be6-46cf-4310-9e17-dbf93bab2314 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.749323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5bac-6988-4cb4-b799-9a5297d74e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.749979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5bac-6988-4cb4-b799-9a5297d74e59 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.750259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5bac-6988-4cb4-b799-9a5297d74e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.750557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5bac-6988-4cb4-b799-9a5297d74e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.762448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 768/1566] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:28.762448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8f4c4-1df7-4d10-a9f2-61639202d8a3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.766786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5bac-6988-4cb4-b799-9a5297d74e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.768477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5bac-6988-4cb4-b799-9a5297d74e59 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.769343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8f4c4-1df7-4d10-a9f2-61639202d8a3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.775187 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1596a-13fe-4cf8-b713-6e7d0b68e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.775916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1596a-13fe-4cf8-b713-6e7d0b68e0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.776209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1596a-13fe-4cf8-b713-6e7d0b68e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.776495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1596a-13fe-4cf8-b713-6e7d0b68e0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.777237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1596a-13fe-4cf8-b713-6e7d0b68e0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:28.777552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1596a-13fe-4cf8-b713-6e7d0b68e0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.779287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1596a-13fe-4cf8-b713-6e7d0b68e0f2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.780305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 799/1567] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:28.781756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5bac-6988-4cb4-b799-9a5297d74e59 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.800262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 769/1568] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:28.800262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1596a-13fe-4cf8-b713-6e7d0b68e0f2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.800614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5bac-6988-4cb4-b799-9a5297d74e59 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.805143 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda6fe2-7f82-4b1e-948a-de924055039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.805879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6fe2-7f82-4b1e-948a-de924055039d admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.806270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6fe2-7f82-4b1e-948a-de924055039d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.806583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6fe2-7f82-4b1e-948a-de924055039d admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.807343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda6fe2-7f82-4b1e-948a-de924055039d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:28.807696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda6fe2-7f82-4b1e-948a-de924055039d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.809382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda6fe2-7f82-4b1e-948a-de924055039d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.813384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1596a-13fe-4cf8-b713-6e7d0b68e0f2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.818722 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1d5b1-fab6-43b8-b72f-5f767f03425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.819505 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1d5b1-fab6-43b8-b72f-5f767f03425e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.819795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1d5b1-fab6-43b8-b72f-5f767f03425e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.820072 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1d5b1-fab6-43b8-b72f-5f767f03425e admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.820817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1d5b1-fab6-43b8-b72f-5f767f03425e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:28.821128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1d5b1-fab6-43b8-b72f-5f767f03425e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.822931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1d5b1-fab6-43b8-b72f-5f767f03425e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.823727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 800/1569] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:28.824980 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda6fe2-7f82-4b1e-948a-de924055039d admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.837060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda6fe2-7f82-4b1e-948a-de924055039d admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.838594 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 770/1570] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:28.839486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1d5b1-fab6-43b8-b72f-5f767f03425e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.851072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338137-9397-4d20-be52-e1d9c9b8791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.852092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338137-9397-4d20-be52-e1d9c9b8791a admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.852416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338137-9397-4d20-be52-e1d9c9b8791a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.852813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338137-9397-4d20-be52-e1d9c9b8791a admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.854682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa338137-9397-4d20-be52-e1d9c9b8791a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:28.855307 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa338137-9397-4d20-be52-e1d9c9b8791a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.857415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa338137-9397-4d20-be52-e1d9c9b8791a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.858193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1d5b1-fab6-43b8-b72f-5f767f03425e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.864206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5726c01-6355-422c-bdf8-9f73c502a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.864764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5726c01-6355-422c-bdf8-9f73c502a0dc admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.865123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5726c01-6355-422c-bdf8-9f73c502a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.865475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5726c01-6355-422c-bdf8-9f73c502a0dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.866812 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5726c01-6355-422c-bdf8-9f73c502a0dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:28.867130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5726c01-6355-422c-bdf8-9f73c502a0dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.869304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5726c01-6355-422c-bdf8-9f73c502a0dc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.871926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 801/1571] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:28.873632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338137-9397-4d20-be52-e1d9c9b8791a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.886236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338137-9397-4d20-be52-e1d9c9b8791a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.895042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 771/1572] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:28.895042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5726c01-6355-422c-bdf8-9f73c502a0dc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.895369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3dac8-6be8-4cce-9f92-39d60a97fc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.895369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3dac8-6be8-4cce-9f92-39d60a97fc70 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.895369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3dac8-6be8-4cce-9f92-39d60a97fc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.895369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3dac8-6be8-4cce-9f92-39d60a97fc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.895710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3dac8-6be8-4cce-9f92-39d60a97fc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.895710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3dac8-6be8-4cce-9f92-39d60a97fc70 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.902764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5726c01-6355-422c-bdf8-9f73c502a0dc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.908874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a505b-f93b-4a82-9b82-f274423d6d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.909073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 802/1573] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:28.910088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3dac8-6be8-4cce-9f92-39d60a97fc70 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.912606 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a505b-f93b-4a82-9b82-f274423d6d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.912887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a505b-f93b-4a82-9b82-f274423d6d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.913179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a505b-f93b-4a82-9b82-f274423d6d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.913897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a505b-f93b-4a82-9b82-f274423d6d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.915886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a505b-f93b-4a82-9b82-f274423d6d87 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.922064 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3dac8-6be8-4cce-9f92-39d60a97fc70 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:28.929178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386cc8c-9cec-4362-9cd1-5d8621c70a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:28.929863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386cc8c-9cec-4362-9cd1-5d8621c70a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:28.930336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386cc8c-9cec-4362-9cd1-5d8621c70a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:28.930602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386cc8c-9cec-4362-9cd1-5d8621c70a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:28.931514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386cc8c-9cec-4362-9cd1-5d8621c70a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:28.933594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386cc8c-9cec-4362-9cd1-5d8621c70a1c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:28.950974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 772/1574] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:28.950974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a505b-f93b-4a82-9b82-f274423d6d87 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:28.966627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 803/1575] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:28.967840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386cc8c-9cec-4362-9cd1-5d8621c70a1c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.005665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:29.031389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a505b-f93b-4a82-9b82-f274423d6d87 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.044199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386cc8c-9cec-4362-9cd1-5d8621c70a1c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.049520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e04ee-5767-4208-9130-98387300e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.050438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e04ee-5767-4208-9130-98387300e154 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.050837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e04ee-5767-4208-9130-98387300e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.051157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e04ee-5767-4208-9130-98387300e154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.051999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e04ee-5767-4208-9130-98387300e154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.053955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e04ee-5767-4208-9130-98387300e154 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.092909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 804/1576] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:29.092909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e04ee-5767-4208-9130-98387300e154 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.108648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c93fb9-90ae-4ce6-bc73-a5006125ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.109463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c93fb9-90ae-4ce6-bc73-a5006125ab3b admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.109826 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c93fb9-90ae-4ce6-bc73-a5006125ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.110164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c93fb9-90ae-4ce6-bc73-a5006125ab3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.111020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c93fb9-90ae-4ce6-bc73-a5006125ab3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.113428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c93fb9-90ae-4ce6-bc73-a5006125ab3b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.158252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 773/1577] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:28 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:29.159449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c93fb9-90ae-4ce6-bc73-a5006125ab3b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.169926 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:29.174940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e04ee-5767-4208-9130-98387300e154 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.244666 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c93fb9-90ae-4ce6-bc73-a5006125ab3b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.250916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd3fab-b502-4d47-a38a-e13609f3b0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.252065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3fab-b502-4d47-a38a-e13609f3b0ba admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.252065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3fab-b502-4d47-a38a-e13609f3b0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.252287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3fab-b502-4d47-a38a-e13609f3b0ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.253752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd3fab-b502-4d47-a38a-e13609f3b0ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.257277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd3fab-b502-4d47-a38a-e13609f3b0ba admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.261771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ddbd8-8056-4b72-855c-9a083efce6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.262891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ddbd8-8056-4b72-855c-9a083efce6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.263452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ddbd8-8056-4b72-855c-9a083efce6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.263917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ddbd8-8056-4b72-855c-9a083efce6f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.265053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ddbd8-8056-4b72-855c-9a083efce6f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.267614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ddbd8-8056-4b72-855c-9a083efce6f6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.294583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 774/1578] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:29 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:29.294583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd3fab-b502-4d47-a38a-e13609f3b0ba admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.303818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 805/1579] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:29 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:29.308594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ddbd8-8056-4b72-855c-9a083efce6f6 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.362400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:29.369850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd3fab-b502-4d47-a38a-e13609f3b0ba admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.383600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ddbd8-8056-4b72-855c-9a083efce6f6 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.390487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6dc9d-1342-4bdf-ba5f-cf05ddfbb106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.391259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6dc9d-1342-4bdf-ba5f-cf05ddfbb106 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.391471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6dc9d-1342-4bdf-ba5f-cf05ddfbb106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.391741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6dc9d-1342-4bdf-ba5f-cf05ddfbb106 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.392448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6dc9d-1342-4bdf-ba5f-cf05ddfbb106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.394843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6dc9d-1342-4bdf-ba5f-cf05ddfbb106 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.421448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 806/1580] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:29 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:29.421688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6dc9d-1342-4bdf-ba5f-cf05ddfbb106 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.433966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6dc9d-1342-4bdf-ba5f-cf05ddfbb106 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.440977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab977d0e-4b2c-43a3-95ab-ef42e04f55c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.442243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab977d0e-4b2c-43a3-95ab-ef42e04f55c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.442568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab977d0e-4b2c-43a3-95ab-ef42e04f55c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.442852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab977d0e-4b2c-43a3-95ab-ef42e04f55c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.443843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab977d0e-4b2c-43a3-95ab-ef42e04f55c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.446374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab977d0e-4b2c-43a3-95ab-ef42e04f55c8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.450078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421ea42-0dbd-40e0-8264-45a609d3f010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.450836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ea42-0dbd-40e0-8264-45a609d3f010 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.451114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ea42-0dbd-40e0-8264-45a609d3f010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.451387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ea42-0dbd-40e0-8264-45a609d3f010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.452146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421ea42-0dbd-40e0-8264-45a609d3f010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.454257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421ea42-0dbd-40e0-8264-45a609d3f010 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.471434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 775/1581] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.471434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421ea42-0dbd-40e0-8264-45a609d3f010 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.476633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 807/1582] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:29 2022] POST /identity/v3/users => generated 297 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:29.477619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab977d0e-4b2c-43a3-95ab-ef42e04f55c8 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.486315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421ea42-0dbd-40e0-8264-45a609d3f010 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.488573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09350e52-0eb4-46cb-a7d8-d9817b7531df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.489263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09350e52-0eb4-46cb-a7d8-d9817b7531df admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.489609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09350e52-0eb4-46cb-a7d8-d9817b7531df admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.489872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09350e52-0eb4-46cb-a7d8-d9817b7531df admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.490972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab977d0e-4b2c-43a3-95ab-ef42e04f55c8 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.491179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09350e52-0eb4-46cb-a7d8-d9817b7531df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.497664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09350e52-0eb4-46cb-a7d8-d9817b7531df admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.497812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f5970-b91b-4f1d-8005-dfc8ed938465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.499119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5970-b91b-4f1d-8005-dfc8ed938465 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.499621 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5970-b91b-4f1d-8005-dfc8ed938465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.500247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5970-b91b-4f1d-8005-dfc8ed938465 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.501841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f5970-b91b-4f1d-8005-dfc8ed938465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.506827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f5970-b91b-4f1d-8005-dfc8ed938465 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.525987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 776/1583] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:29 2022] POST /identity/v3/users => generated 302 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:29.529276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09350e52-0eb4-46cb-a7d8-d9817b7531df admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.538422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09350e52-0eb4-46cb-a7d8-d9817b7531df admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.541528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 808/1584] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:29 2022] POST /identity/v3/users => generated 287 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:29.542432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f5970-b91b-4f1d-8005-dfc8ed938465 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.544132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bdee3-3933-414e-98c7-7143d9370b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.544823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bdee3-3933-414e-98c7-7143d9370b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.545105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bdee3-3933-414e-98c7-7143d9370b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.545384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bdee3-3933-414e-98c7-7143d9370b21 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.546121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bdee3-3933-414e-98c7-7143d9370b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.548854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bdee3-3933-414e-98c7-7143d9370b21 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.571710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f5970-b91b-4f1d-8005-dfc8ed938465 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.571968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:29.578729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a123c-8d38-4ab1-8a13-1266bb106f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.579460 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a123c-8d38-4ab1-8a13-1266bb106f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.579740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a123c-8d38-4ab1-8a13-1266bb106f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.580011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a123c-8d38-4ab1-8a13-1266bb106f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.580718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a123c-8d38-4ab1-8a13-1266bb106f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.581904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 777/1585] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:29 2022] POST /identity/v3/users => generated 288 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:29.586564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a123c-8d38-4ab1-8a13-1266bb106f03 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.589187 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bdee3-3933-414e-98c7-7143d9370b21 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.602443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bdee3-3933-414e-98c7-7143d9370b21 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.611664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd4b75-968d-4308-a577-de2b6417ef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.612521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd4b75-968d-4308-a577-de2b6417ef35 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.612887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd4b75-968d-4308-a577-de2b6417ef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.613366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd4b75-968d-4308-a577-de2b6417ef35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.613892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 809/1586] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:29 2022] POST /identity/v3/users => generated 287 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:29.614295 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd4b75-968d-4308-a577-de2b6417ef35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.614630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a123c-8d38-4ab1-8a13-1266bb106f03 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.616050 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd4b75-968d-4308-a577-de2b6417ef35 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.626376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a123c-8d38-4ab1-8a13-1266bb106f03 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.633003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffe4d9-28b7-4d5e-ac3e-702870fd0676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.634009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffe4d9-28b7-4d5e-ac3e-702870fd0676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.634356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffe4d9-28b7-4d5e-ac3e-702870fd0676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.634776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffe4d9-28b7-4d5e-ac3e-702870fd0676 admin admin] PATH_INFO: `/v3/projects/5d4c799515b04fff924caa9819be4faf/users/60dbe36087e14f9e8bf885977b0e7426/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.636042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 778/1587] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.640757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd4b75-968d-4308-a577-de2b6417ef35 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.655811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd4b75-968d-4308-a577-de2b6417ef35 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.660412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffe4d9-28b7-4d5e-ac3e-702870fd0676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4c799515b04fff924caa9819be4faf, user_id=60dbe36087e14f9e8bf885977b0e7426, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.661160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd38ce5-ee7e-40c3-b2bd-3e888006ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.661860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38ce5-ee7e-40c3-b2bd-3e888006ca68 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.662652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38ce5-ee7e-40c3-b2bd-3e888006ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.662935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38ce5-ee7e-40c3-b2bd-3e888006ca68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.663703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd38ce5-ee7e-40c3-b2bd-3e888006ca68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.664141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffe4d9-28b7-4d5e-ac3e-702870fd0676 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.665319 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd38ce5-ee7e-40c3-b2bd-3e888006ca68 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.677344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 779/1588] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.678265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd38ce5-ee7e-40c3-b2bd-3e888006ca68 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.684696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 810/1589] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:29 2022] PUT /identity/v3/projects/5d4c799515b04fff924caa9819be4faf/users/60dbe36087e14f9e8bf885977b0e7426/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:29.684696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffe4d9-28b7-4d5e-ac3e-702870fd0676 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.689377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd38ce5-ee7e-40c3-b2bd-3e888006ca68 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.763346 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009e84d-30dd-4ab2-8d9e-c56c0ca35c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.764133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e84d-30dd-4ab2-8d9e-c56c0ca35c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.764687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e84d-30dd-4ab2-8d9e-c56c0ca35c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.764966 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e84d-30dd-4ab2-8d9e-c56c0ca35c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.765937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009e84d-30dd-4ab2-8d9e-c56c0ca35c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.767549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffe4d9-28b7-4d5e-ac3e-702870fd0676 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.768039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009e84d-30dd-4ab2-8d9e-c56c0ca35c02 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.772831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8189bb4-4db2-47e1-85d2-cfaee236e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.773531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8189bb4-4db2-47e1-85d2-cfaee236e1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.773813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8189bb4-4db2-47e1-85d2-cfaee236e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.774092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8189bb4-4db2-47e1-85d2-cfaee236e1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.775042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8189bb4-4db2-47e1-85d2-cfaee236e1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.777245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8189bb4-4db2-47e1-85d2-cfaee236e1cc admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.783938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 780/1590] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.785713 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009e84d-30dd-4ab2-8d9e-c56c0ca35c02 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.796603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 811/1591] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.797910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8189bb4-4db2-47e1-85d2-cfaee236e1cc admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.801337 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009e84d-30dd-4ab2-8d9e-c56c0ca35c02 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.809600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8189bb4-4db2-47e1-85d2-cfaee236e1cc admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.810470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9df6a-c554-4a0b-87a6-56b4250ca8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.811742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9df6a-c554-4a0b-87a6-56b4250ca8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.812232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9df6a-c554-4a0b-87a6-56b4250ca8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.812694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9df6a-c554-4a0b-87a6-56b4250ca8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.813690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9df6a-c554-4a0b-87a6-56b4250ca8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.815740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9df6a-c554-4a0b-87a6-56b4250ca8b9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.815938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9354df0-92cb-4f42-b1de-ac6aa27b1d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.816687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9354df0-92cb-4f42-b1de-ac6aa27b1d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.817029 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9354df0-92cb-4f42-b1de-ac6aa27b1d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.817372 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9354df0-92cb-4f42-b1de-ac6aa27b1d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.818373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9354df0-92cb-4f42-b1de-ac6aa27b1d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.820438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9354df0-92cb-4f42-b1de-ac6aa27b1d23 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.832872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 812/1592] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.834088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 781/1593] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.835938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9df6a-c554-4a0b-87a6-56b4250ca8b9 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.837230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9354df0-92cb-4f42-b1de-ac6aa27b1d23 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.849656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9df6a-c554-4a0b-87a6-56b4250ca8b9 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.851363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9354df0-92cb-4f42-b1de-ac6aa27b1d23 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.856631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9911666-f6e3-4dd2-b02c-ad89b3e774fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.857443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911666-f6e3-4dd2-b02c-ad89b3e774fa admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.857790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911666-f6e3-4dd2-b02c-ad89b3e774fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.858132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911666-f6e3-4dd2-b02c-ad89b3e774fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.859018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624235c-001a-4de0-a2ee-c22b25939c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.859168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9911666-f6e3-4dd2-b02c-ad89b3e774fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.860050 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624235c-001a-4de0-a2ee-c22b25939c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.860534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624235c-001a-4de0-a2ee-c22b25939c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.861032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9911666-f6e3-4dd2-b02c-ad89b3e774fa admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.861370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624235c-001a-4de0-a2ee-c22b25939c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.862735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624235c-001a-4de0-a2ee-c22b25939c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.864731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624235c-001a-4de0-a2ee-c22b25939c61 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.876588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 813/1594] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.876588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a991f11-434b-4c7e-9811-089fd801fcc8 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.876588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a991f11-434b-4c7e-9811-089fd801fcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.876588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a991f11-434b-4c7e-9811-089fd801fcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.886709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 782/1595] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.888493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624235c-001a-4de0-a2ee-c22b25939c61 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.905230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624235c-001a-4de0-a2ee-c22b25939c61 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.906352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-3a991f11-434b-4c7e-9811-089fd801fcc8 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:29.908192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3a991f11-434b-4c7e-9811-089fd801fcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:29.912778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57016ef-ff22-4896-8362-cb11c4845886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.914287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57016ef-ff22-4896-8362-cb11c4845886 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.914811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57016ef-ff22-4896-8362-cb11c4845886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.915298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57016ef-ff22-4896-8362-cb11c4845886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.916282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57016ef-ff22-4896-8362-cb11c4845886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.918354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57016ef-ff22-4896-8362-cb11c4845886 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.919426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 814/1596] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:29.920276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a991f11-434b-4c7e-9811-089fd801fcc8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.936382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a991f11-434b-4c7e-9811-089fd801fcc8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.940020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 783/1597] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.941410 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57016ef-ff22-4896-8362-cb11c4845886 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.944886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c316-58af-4913-95e1-619fd9695d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.945593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c316-58af-4913-95e1-619fd9695d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.945875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c316-58af-4913-95e1-619fd9695d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.946150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c316-58af-4913-95e1-619fd9695d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.946929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1c316-58af-4913-95e1-619fd9695d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.949524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1c316-58af-4913-95e1-619fd9695d42 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.955371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57016ef-ff22-4896-8362-cb11c4845886 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.961794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6d0a-887e-4bbb-a83a-9ae24c072d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.963746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6d0a-887e-4bbb-a83a-9ae24c072d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.964975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6d0a-887e-4bbb-a83a-9ae24c072d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.965583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6d0a-887e-4bbb-a83a-9ae24c072d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.966715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 815/1598] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.967066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e6d0a-887e-4bbb-a83a-9ae24c072d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.968987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e6d0a-887e-4bbb-a83a-9ae24c072d5d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.970650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c316-58af-4913-95e1-619fd9695d42 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.982490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 784/1599] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:29.983312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c316-58af-4913-95e1-619fd9695d42 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:29.983941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6d0a-887e-4bbb-a83a-9ae24c072d5d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:29.991014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53775dda-3429-4636-8dd1-5ef44f456b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:29.991784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53775dda-3429-4636-8dd1-5ef44f456b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:29.992785 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53775dda-3429-4636-8dd1-5ef44f456b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:29.993261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53775dda-3429-4636-8dd1-5ef44f456b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:29.994337 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53775dda-3429-4636-8dd1-5ef44f456b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:29.997570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53775dda-3429-4636-8dd1-5ef44f456b8c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:29.998561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6d0a-887e-4bbb-a83a-9ae24c072d5d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:30.006426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705a736-2864-4b74-9986-383e3a68cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:30.008460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705a736-2864-4b74-9986-383e3a68cad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.008995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705a736-2864-4b74-9986-383e3a68cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.010129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705a736-2864-4b74-9986-383e3a68cad6 admin admin] PATH_INFO: `/v3/projects/1db3fe97f51f47a98da3cbc8f0d55741/users/da80b9a52feb462faf0469f2ab701fb8/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.014252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 816/1600] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:30.015329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53775dda-3429-4636-8dd1-5ef44f456b8c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:30.022523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:30.032987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53775dda-3429-4636-8dd1-5ef44f456b8c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:30.034760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705a736-2864-4b74-9986-383e3a68cad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db3fe97f51f47a98da3cbc8f0d55741, user_id=da80b9a52feb462faf0469f2ab701fb8, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:30.038871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705a736-2864-4b74-9986-383e3a68cad6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:30.043088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e2a61-2ef9-46c1-a75d-85f4a6416edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:30.046044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e2a61-2ef9-46c1-a75d-85f4a6416edd admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.046345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e2a61-2ef9-46c1-a75d-85f4a6416edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.046800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e2a61-2ef9-46c1-a75d-85f4a6416edd admin admin] PATH_INFO: `/v3/projects/f20791fa785649cfa5df1f60df84dbdb/users/8fc916f852f4433eac4a3a2a12384834/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.063935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 785/1601] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:29 2022] PUT /identity/v3/projects/1db3fe97f51f47a98da3cbc8f0d55741/users/da80b9a52feb462faf0469f2ab701fb8/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:30.065508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705a736-2864-4b74-9986-383e3a68cad6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:30.070074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e2a61-2ef9-46c1-a75d-85f4a6416edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20791fa785649cfa5df1f60df84dbdb, user_id=8fc916f852f4433eac4a3a2a12384834, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:30.074462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e2a61-2ef9-46c1-a75d-85f4a6416edd admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:30.094100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 817/1602] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:30 2022] PUT /identity/v3/projects/f20791fa785649cfa5df1f60df84dbdb/users/8fc916f852f4433eac4a3a2a12384834/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:30.095052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e2a61-2ef9-46c1-a75d-85f4a6416edd admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:30.154332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705a736-2864-4b74-9986-383e3a68cad6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:30.185754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:30.210053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e2a61-2ef9-46c1-a75d-85f4a6416edd admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:30.223494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799a78f-5715-4431-801c-a0f354397771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:30.234040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799a78f-5715-4431-801c-a0f354397771 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.234229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799a78f-5715-4431-801c-a0f354397771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.234626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799a78f-5715-4431-801c-a0f354397771 admin admin] PATH_INFO: `/v3/projects/25884fee7daa4ddd8a0e20ffaf6be7ca/users/7c33111bb0b5448a97d8b56ae66889b9/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.247688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e28fea-1e98-48c5-931d-08228a515a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:30.248999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e28fea-1e98-48c5-931d-08228a515a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.249460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e28fea-1e98-48c5-931d-08228a515a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.249910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e28fea-1e98-48c5-931d-08228a515a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.263700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799a78f-5715-4431-801c-a0f354397771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25884fee7daa4ddd8a0e20ffaf6be7ca, user_id=7c33111bb0b5448a97d8b56ae66889b9, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:30.264794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e28fea-1e98-48c5-931d-08228a515a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:30.266662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799a78f-5715-4431-801c-a0f354397771 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:30.267073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e28fea-1e98-48c5-931d-08228a515a82 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:30.296011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 818/1603] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:30 2022] PUT /identity/v3/projects/25884fee7daa4ddd8a0e20ffaf6be7ca/users/7c33111bb0b5448a97d8b56ae66889b9/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:30.298684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799a78f-5715-4431-801c-a0f354397771 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:30.300042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 786/1604] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:30.302919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e28fea-1e98-48c5-931d-08228a515a82 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:30.328964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e28fea-1e98-48c5-931d-08228a515a82 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:30.458572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799a78f-5715-4431-801c-a0f354397771 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:30.471713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a865d4-09f2-49da-9a15-8a6f774e036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:30.473046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a865d4-09f2-49da-9a15-8a6f774e036b admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.473494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a865d4-09f2-49da-9a15-8a6f774e036b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.473933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a865d4-09f2-49da-9a15-8a6f774e036b admin admin] PATH_INFO: `/v3/projects/9ca668ca0fd74d5b807f7f03038e4ac1/users/560a544c56114d7a8da2eece7fba5e3a/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.481545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f4b5d-0272-485c-8b09-5585d92f0914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:30.483039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4b5d-0272-485c-8b09-5585d92f0914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.483552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4b5d-0272-485c-8b09-5585d92f0914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.484057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4b5d-0272-485c-8b09-5585d92f0914 admin admin] PATH_INFO: `/v3/projects/8b1b7d70b3b44138bd6f80d9b24ce476/users/e6c1a85eee1549ebafcae52711e5d967/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.524209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f4b5d-0272-485c-8b09-5585d92f0914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1b7d70b3b44138bd6f80d9b24ce476, user_id=e6c1a85eee1549ebafcae52711e5d967, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:30.531985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f4b5d-0272-485c-8b09-5585d92f0914 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:30.549392 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a865d4-09f2-49da-9a15-8a6f774e036b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca668ca0fd74d5b807f7f03038e4ac1, user_id=560a544c56114d7a8da2eece7fba5e3a, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:30.552692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a865d4-09f2-49da-9a15-8a6f774e036b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:30.562862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 787/1605] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:30 2022] PUT /identity/v3/projects/8b1b7d70b3b44138bd6f80d9b24ce476/users/e6c1a85eee1549ebafcae52711e5d967/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:30.574466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f4b5d-0272-485c-8b09-5585d92f0914 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:30.582739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 819/1606] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:30 2022] PUT /identity/v3/projects/9ca668ca0fd74d5b807f7f03038e4ac1/users/560a544c56114d7a8da2eece7fba5e3a/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:30.582739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ec281-2e66-432c-82a9-c15e5395f4f2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.582739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ec281-2e66-432c-82a9-c15e5395f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.582739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ec281-2e66-432c-82a9-c15e5395f4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.605267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e91ec281-2e66-432c-82a9-c15e5395f4f2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:30.606498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e91ec281-2e66-432c-82a9-c15e5395f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:30.679362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:30.708749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f4b5d-0272-485c-8b09-5585d92f0914 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:30.735967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 820/1607] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:30.737352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b663792-f3b0-438e-b127-e8830d6f9ca0 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.737638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b663792-f3b0-438e-b127-e8830d6f9ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.737916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b663792-f3b0-438e-b127-e8830d6f9ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.770028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0b663792-f3b0-438e-b127-e8830d6f9ca0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:30.773958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0b663792-f3b0-438e-b127-e8830d6f9ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:30.803071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 821/1608] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:30.804519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6a52c-0958-4352-965a-58a0208ac143 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.804815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6a52c-0958-4352-965a-58a0208ac143 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.805140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6a52c-0958-4352-965a-58a0208ac143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.911109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-4fd6a52c-0958-4352-965a-58a0208ac143 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:30.911109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4fd6a52c-0958-4352-965a-58a0208ac143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:30.911760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:30.912296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 822/1609] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:30.912382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44892df5-0985-4e44-b029-6562db9be502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:30.912382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892df5-0985-4e44-b029-6562db9be502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.912382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892df5-0985-4e44-b029-6562db9be502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.912382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892df5-0985-4e44-b029-6562db9be502 admin admin] PATH_INFO: `/v3/projects/fecb66f4a7094cd3963caf460c52b88b/users/595531abf958489795f2363026697a5b/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.912682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2fce2-98bb-4c53-9bc7-432280ddd516 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.912682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2fce2-98bb-4c53-9bc7-432280ddd516 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.912682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2fce2-98bb-4c53-9bc7-432280ddd516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:30.927638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e7e2fce2-98bb-4c53-9bc7-432280ddd516 None None] MFA Rules not processed for user `e6c1a85eee1549ebafcae52711e5d967`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:30.928856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44892df5-0985-4e44-b029-6562db9be502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecb66f4a7094cd3963caf460c52b88b, user_id=595531abf958489795f2363026697a5b, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:30.929740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e7e2fce2-98bb-4c53-9bc7-432280ddd516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:30.935846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44892df5-0985-4e44-b029-6562db9be502 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:30.963781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 788/1610] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:30 2022] PUT /identity/v3/projects/fecb66f4a7094cd3963caf460c52b88b/users/595531abf958489795f2363026697a5b/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:30.966836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3099-8ac1-4797-af32-10581582a947 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:30.967125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3099-8ac1-4797-af32-10581582a947 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:30.967728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3099-8ac1-4797-af32-10581582a947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.020167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f2ab3099-8ac1-4797-af32-10581582a947 None None] MFA Rules not processed for user `560a544c56114d7a8da2eece7fba5e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:31.021370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f2ab3099-8ac1-4797-af32-10581582a947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:31.051150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 823/1611] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:31.052804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2fce2-98bb-4c53-9bc7-432280ddd516 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:31.174147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2fce2-98bb-4c53-9bc7-432280ddd516 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:31.176233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 789/1612] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:31.177270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab3099-8ac1-4797-af32-10581582a947 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:31.258664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab3099-8ac1-4797-af32-10581582a947 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:31.267786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ea98d-4ff9-4128-b90e-6eb06fe7348c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:31.268749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea98d-4ff9-4128-b90e-6eb06fe7348c service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.269089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea98d-4ff9-4128-b90e-6eb06fe7348c service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.269416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea98d-4ff9-4128-b90e-6eb06fe7348c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.285386 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d5a17-2f16-4f4e-8803-909b0db7efba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:31.286836 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d5a17-2f16-4f4e-8803-909b0db7efba service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.287492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d5a17-2f16-4f4e-8803-909b0db7efba service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.288193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d5a17-2f16-4f4e-8803-909b0db7efba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.345455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:31.385260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d5a17-2f16-4f4e-8803-909b0db7efba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:31.389596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d5a17-2f16-4f4e-8803-909b0db7efba service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:31.401021 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 824/1613] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:31.401942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d5a17-2f16-4f4e-8803-909b0db7efba service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:31.404301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ea98d-4ff9-4128-b90e-6eb06fe7348c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:31.406578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ea98d-4ff9-4128-b90e-6eb06fe7348c service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:31.411333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d5a17-2f16-4f4e-8803-909b0db7efba service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:31.415549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf559a-c208-4169-a27b-b46af3924313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:31.416262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf559a-c208-4169-a27b-b46af3924313 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.416552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf559a-c208-4169-a27b-b46af3924313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.416837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf559a-c208-4169-a27b-b46af3924313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.421424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 790/1614] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:31.423860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec333-5970-4add-a02c-fbce9200bf67 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.424647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec333-5970-4add-a02c-fbce9200bf67 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.425343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec333-5970-4add-a02c-fbce9200bf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.429362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf559a-c208-4169-a27b-b46af3924313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:31.432038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf559a-c208-4169-a27b-b46af3924313 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:31.444548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 825/1615] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:31.445928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abe63f-c542-4b8d-8188-672564f635fe None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.446222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abe63f-c542-4b8d-8188-672564f635fe None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.446532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abe63f-c542-4b8d-8188-672564f635fe None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.448942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 826/1616] 10.222.0.66 () {54 vars in 961 bytes} [Wed Jun 22 10:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:20:31.450004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcfecb-7dca-4d6f-9784-2204357a9044 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.450360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcfecb-7dca-4d6f-9784-2204357a9044 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.450673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcfecb-7dca-4d6f-9784-2204357a9044 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.452570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 827/1617] 10.222.0.66 () {54 vars in 961 bytes} [Wed Jun 22 10:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:20:31.454200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ed1ec333-5970-4add-a02c-fbce9200bf67 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:31.455569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59e4b-cde3-4bc5-b54a-fffcc9500a54 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.455927 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59e4b-cde3-4bc5-b54a-fffcc9500a54 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.456314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59e4b-cde3-4bc5-b54a-fffcc9500a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.456761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ed1ec333-5970-4add-a02c-fbce9200bf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:31.473821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 791/1618] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:31.474848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49e193-ef07-4481-8266-a4035aa5ac76 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.475101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49e193-ef07-4481-8266-a4035aa5ac76 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.475385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49e193-ef07-4481-8266-a4035aa5ac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.489548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-72e59e4b-cde3-4bc5-b54a-fffcc9500a54 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:31.491782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-72e59e4b-cde3-4bc5-b54a-fffcc9500a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:31.505898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7d49e193-ef07-4481-8266-a4035aa5ac76 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:31.507628 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7d49e193-ef07-4481-8266-a4035aa5ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:31.514938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:31.651139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 792/1619] 10.222.0.66 () {58 vars in 1058 bytes} [Wed Jun 22 10:20:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:31.652165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49e193-ef07-4481-8266-a4035aa5ac76 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:31.670171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 828/1620] 10.222.0.66 () {58 vars in 1058 bytes} [Wed Jun 22 10:20:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:31.670980 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49e193-ef07-4481-8266-a4035aa5ac76 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:31.672043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e59e4b-cde3-4bc5-b54a-fffcc9500a54 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:31.684626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196019-daee-4cb0-a8d1-9e4ec1f64626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:31.685303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196019-daee-4cb0-a8d1-9e4ec1f64626 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.685594 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196019-daee-4cb0-a8d1-9e4ec1f64626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.685872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196019-daee-4cb0-a8d1-9e4ec1f64626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.692160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e59e4b-cde3-4bc5-b54a-fffcc9500a54 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:31.706153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a6d99-e4bf-473f-92ed-d73c3a77c3b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:31.706933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a6d99-e4bf-473f-92ed-d73c3a77c3b7 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.707854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a6d99-e4bf-473f-92ed-d73c3a77c3b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.712971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1196019-daee-4cb0-a8d1-9e4ec1f64626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:31.714044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a6d99-e4bf-473f-92ed-d73c3a77c3b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.714468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1196019-daee-4cb0-a8d1-9e4ec1f64626 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:31.724275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a6d99-e4bf-473f-92ed-d73c3a77c3b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:31.726194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a6d99-e4bf-473f-92ed-d73c3a77c3b7 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:31.737870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 829/1621] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:31.738803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a6d99-e4bf-473f-92ed-d73c3a77c3b7 service nova] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:31.743834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 793/1622] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:31.752309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a6d99-e4bf-473f-92ed-d73c3a77c3b7 service nova] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:31.759896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0978b0-e1e0-4e3d-9cbb-aa61da7341c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:31.761446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0978b0-e1e0-4e3d-9cbb-aa61da7341c1 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:31.761735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0978b0-e1e0-4e3d-9cbb-aa61da7341c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:31.762014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0978b0-e1e0-4e3d-9cbb-aa61da7341c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:31.878430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0978b0-e1e0-4e3d-9cbb-aa61da7341c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:31.881432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0978b0-e1e0-4e3d-9cbb-aa61da7341c1 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:31.894909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 830/1623] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:32.154252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076639a8-382a-42af-b94b-be22072aac2d None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:32.154905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076639a8-382a-42af-b94b-be22072aac2d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:32.155062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076639a8-382a-42af-b94b-be22072aac2d None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:32.157010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 794/1624] 10.222.0.66 () {54 vars in 912 bytes} [Wed Jun 22 10:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:20:32.163561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2db1c-2119-45c4-9d79-4819672d0231 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:32.163861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2db1c-2119-45c4-9d79-4819672d0231 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:32.164141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2db1c-2119-45c4-9d79-4819672d0231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:32.207458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-7dc2db1c-2119-45c4-9d79-4819672d0231 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:32.209299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-7dc2db1c-2119-45c4-9d79-4819672d0231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:32.234464 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 831/1625] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:20:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:32.249689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076639a8-382a-42af-b94b-be22072aac2d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:32.370162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef4890-e32d-4064-9367-ff804f3d2811 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:32.370793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef4890-e32d-4064-9367-ff804f3d2811 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:32.371307 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef4890-e32d-4064-9367-ff804f3d2811 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:32.373257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 832/1626] 10.222.0.66 () {54 vars in 912 bytes} [Wed Jun 22 10:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:20:32.379643 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417203-9c3f-45d9-8847-77943f1a4d59 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:32.380193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417203-9c3f-45d9-8847-77943f1a4d59 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:32.380650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417203-9c3f-45d9-8847-77943f1a4d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:32.384599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076639a8-382a-42af-b94b-be22072aac2d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:32.394892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5be03-0a42-4f31-9b49-15fd47f79b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:32.395905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5be03-0a42-4f31-9b49-15fd47f79b06 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:32.395905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5be03-0a42-4f31-9b49-15fd47f79b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:32.396120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5be03-0a42-4f31-9b49-15fd47f79b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:32.406225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-13417203-9c3f-45d9-8847-77943f1a4d59 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:32.408024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-13417203-9c3f-45d9-8847-77943f1a4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:32.424246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5be03-0a42-4f31-9b49-15fd47f79b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:32.426630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5be03-0a42-4f31-9b49-15fd47f79b06 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:32.429614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 833/1627] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:20:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:32.439642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417203-9c3f-45d9-8847-77943f1a4d59 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:32.453281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 795/1628] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:32.457511 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417203-9c3f-45d9-8847-77943f1a4d59 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:32.465585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549054b-78c6-4f9f-a82b-a23abdbe1f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:32.466786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549054b-78c6-4f9f-a82b-a23abdbe1f38 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:32.467479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549054b-78c6-4f9f-a82b-a23abdbe1f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:32.468626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549054b-78c6-4f9f-a82b-a23abdbe1f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:32.485135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549054b-78c6-4f9f-a82b-a23abdbe1f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:32.486921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549054b-78c6-4f9f-a82b-a23abdbe1f38 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:32.503093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 834/1629] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:33.024686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5be03-0a42-4f31-9b49-15fd47f79b06 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:33.038391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5be03-0a42-4f31-9b49-15fd47f79b06 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:33.052692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:33.053597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:33.053877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:33.054964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] PATH_INFO: `/v3/users/e6c1a85eee1549ebafcae52711e5d967` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:33.057821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c1a85eee1549ebafcae52711e5d967)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:33.062090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:33.217747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c1a85eee1549ebafcae52711e5d967'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:33.237266 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c1a85eee1549ebafcae52711e5d967'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:33.238071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c1a85eee1549ebafcae52711e5d967'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:33.272336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c1a85eee1549ebafcae52711e5d967'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:33.294388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c1a85eee1549ebafcae52711e5d967'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:33.314305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 796/1630] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:33 2022] DELETE /identity/v3/users/e6c1a85eee1549ebafcae52711e5d967 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:33.319166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc88f1-ec87-430f-b72d-272ade62a24b None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:33.320182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc88f1-ec87-430f-b72d-272ade62a24b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:33.320683 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc88f1-ec87-430f-b72d-272ade62a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:33.332731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:33.356764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-06dc88f1-ec87-430f-b72d-272ade62a24b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:33.359496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-06dc88f1-ec87-430f-b72d-272ade62a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:33.511457 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 835/1631] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:33.693322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:33.695597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:33.704613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:33.986170 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2718858-cab6-4b65-9a8f-7824dc095a2c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:33.999944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87958d56-7afc-4023-8060-978dadb24913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:34.000171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87958d56-7afc-4023-8060-978dadb24913 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.000307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87958d56-7afc-4023-8060-978dadb24913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.000536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87958d56-7afc-4023-8060-978dadb24913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.027274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87958d56-7afc-4023-8060-978dadb24913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:34.028776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87958d56-7afc-4023-8060-978dadb24913 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:34.059772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 797/1632] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:34.728133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204664d-4c06-4440-8951-94c892512f20 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.729333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204664d-4c06-4440-8951-94c892512f20 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.729835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204664d-4c06-4440-8951-94c892512f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.816347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a204664d-4c06-4440-8951-94c892512f20 None None] MFA Rules not processed for user `7c33111bb0b5448a97d8b56ae66889b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:34.818009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a204664d-4c06-4440-8951-94c892512f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:35.037854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 836/1633] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:35.041886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87958d56-7afc-4023-8060-978dadb24913 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:35.046987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-87958d56-7afc-4023-8060-978dadb24913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:35.066951 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87958d56-7afc-4023-8060-978dadb24913 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:35.086711 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416536aa-613e-4f53-a7b7-1cdb9481cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:35.087406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416536aa-613e-4f53-a7b7-1cdb9481cc57 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:35.087695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416536aa-613e-4f53-a7b7-1cdb9481cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:35.088052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416536aa-613e-4f53-a7b7-1cdb9481cc57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:35.088777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416536aa-613e-4f53-a7b7-1cdb9481cc57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:35.090776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416536aa-613e-4f53-a7b7-1cdb9481cc57 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:35.174868 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 798/1634] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:35 2022] POST /identity/v3/projects => generated 405 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:35.179226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204664d-4c06-4440-8951-94c892512f20 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:35.195844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204664d-4c06-4440-8951-94c892512f20 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:35.385528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416536aa-613e-4f53-a7b7-1cdb9481cc57 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:35.393006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-416536aa-613e-4f53-a7b7-1cdb9481cc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:35.431114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679b873-ad4d-4994-a309-8f422c4afa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:35.431909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b873-ad4d-4994-a309-8f422c4afa5b admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:35.432199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b873-ad4d-4994-a309-8f422c4afa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:35.432494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b873-ad4d-4994-a309-8f422c4afa5b admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:35.433268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679b873-ad4d-4994-a309-8f422c4afa5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:35.443528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679b873-ad4d-4994-a309-8f422c4afa5b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:35.496783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 837/1635] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:35 2022] POST /identity/v3/users => generated 309 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:35.505189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679b873-ad4d-4994-a309-8f422c4afa5b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:35.530311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679b873-ad4d-4994-a309-8f422c4afa5b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:35.551219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b4237-bda1-4669-8699-7774773c64aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:35.551486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b4237-bda1-4669-8699-7774773c64aa admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:35.551590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b4237-bda1-4669-8699-7774773c64aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:35.551865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b4237-bda1-4669-8699-7774773c64aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:35.552636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b4237-bda1-4669-8699-7774773c64aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:35.554327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b4237-bda1-4669-8699-7774773c64aa admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:35.590934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 838/1636] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:35.593120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b4237-bda1-4669-8699-7774773c64aa admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:35.609220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416536aa-613e-4f53-a7b7-1cdb9481cc57 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:35.613794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b4237-bda1-4669-8699-7774773c64aa admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:35.632163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:35.633132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:35.633424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:35.633710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] PATH_INFO: `/v3/projects/8b1b7d70b3b44138bd6f80d9b24ce476` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:35.635501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5f225-af07-4163-9c99-a5461895e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:35.636411 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1b7d70b3b44138bd6f80d9b24ce476)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:35.641149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: WARNING py.warnings [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:20:35.641149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: warnings.warn(msg) Jun 22 10:20:35.641149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: Jun 22 10:20:35.641149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:35.646631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5f225-af07-4163-9c99-a5461895e8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:35.647381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5f225-af07-4163-9c99-a5461895e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:35.648414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5f225-af07-4163-9c99-a5461895e8b6 admin admin] PATH_INFO: `/v3/projects/10aa2a33ce6e47b9b247f887215977b3/users/a6ade7726b4346c38e0eb2755d91d1e4/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:35.666696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:35.679759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5f225-af07-4163-9c99-a5461895e8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10aa2a33ce6e47b9b247f887215977b3, user_id=a6ade7726b4346c38e0eb2755d91d1e4, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:35.684477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5f225-af07-4163-9c99-a5461895e8b6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:35.728443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 839/1637] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:35 2022] PUT /identity/v3/projects/10aa2a33ce6e47b9b247f887215977b3/users/a6ade7726b4346c38e0eb2755d91d1e4/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:35.740088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5f225-af07-4163-9c99-a5461895e8b6 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:35.830560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1b7d70b3b44138bd6f80d9b24ce476', 'request_id': 'req-513032f0-1ddc-489d-9a0f-92c6ae228c81'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:35.856555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1b7d70b3b44138bd6f80d9b24ce476', 'request_id': 'req-513032f0-1ddc-489d-9a0f-92c6ae228c81'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:35.873600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1b7d70b3b44138bd6f80d9b24ce476', 'request_id': 'req-513032f0-1ddc-489d-9a0f-92c6ae228c81'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:35.885479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5f225-af07-4163-9c99-a5461895e8b6 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:35.913747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] The token cache is being invalidate because project 8b1b7d70b3b44138bd6f80d9b24ce476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:35.913747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:35.969595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-513032f0-1ddc-489d-9a0f-92c6ae228c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:35.969595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 799/1638] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:35 2022] DELETE /identity/v3/projects/8b1b7d70b3b44138bd6f80d9b24ce476 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:35.969595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9548d-ed23-443b-9f28-bb092bda8f1b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:35.969595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9548d-ed23-443b-9f28-bb092bda8f1b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:35.969595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9548d-ed23-443b-9f28-bb092bda8f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.008049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-63a9548d-ed23-443b-9f28-bb092bda8f1b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:36.011879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-63a9548d-ed23-443b-9f28-bb092bda8f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:36.047690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:36.052160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921d376-c55d-4b6c-a15f-17c85be23552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:36.052855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d376-c55d-4b6c-a15f-17c85be23552 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.053136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d376-c55d-4b6c-a15f-17c85be23552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.053408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d376-c55d-4b6c-a15f-17c85be23552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.054152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921d376-c55d-4b6c-a15f-17c85be23552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:36.055976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921d376-c55d-4b6c-a15f-17c85be23552 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:36.080135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 840/1639] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:36.084114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921d376-c55d-4b6c-a15f-17c85be23552 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:36.085944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9921d376-c55d-4b6c-a15f-17c85be23552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:36.116869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921d376-c55d-4b6c-a15f-17c85be23552 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:36.124798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 800/1640] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:36.130192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680158ff-4998-4b7f-8296-5294412deacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:36.131487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680158ff-4998-4b7f-8296-5294412deacc admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.131771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680158ff-4998-4b7f-8296-5294412deacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.132665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680158ff-4998-4b7f-8296-5294412deacc admin admin] PATH_INFO: `/v3/projects/10aa2a33ce6e47b9b247f887215977b3/users/a6ade7726b4346c38e0eb2755d91d1e4/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.132999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e710db4-8753-4040-93d8-e0247e309842 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.133627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e710db4-8753-4040-93d8-e0247e309842 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.133922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e710db4-8753-4040-93d8-e0247e309842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.134570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680158ff-4998-4b7f-8296-5294412deacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=10aa2a33ce6e47b9b247f887215977b3, user_id=a6ade7726b4346c38e0eb2755d91d1e4, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:36.137491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680158ff-4998-4b7f-8296-5294412deacc admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:36.160535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 841/1641] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:36 2022] PUT /identity/v3/projects/10aa2a33ce6e47b9b247f887215977b3/users/a6ade7726b4346c38e0eb2755d91d1e4/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:36.200210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4e710db4-8753-4040-93d8-e0247e309842 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:36.203367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4e710db4-8753-4040-93d8-e0247e309842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:36.371937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 801/1642] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:36.372664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680158ff-4998-4b7f-8296-5294412deacc admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:36.395939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680158ff-4998-4b7f-8296-5294412deacc admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:36.403297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed0b59-1313-4d31-94fd-e7b5ed09533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:36.404079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed0b59-1313-4d31-94fd-e7b5ed09533d admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.404370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed0b59-1313-4d31-94fd-e7b5ed09533d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.404649 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed0b59-1313-4d31-94fd-e7b5ed09533d admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.405407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed0b59-1313-4d31-94fd-e7b5ed09533d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:36.405712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed0b59-1313-4d31-94fd-e7b5ed09533d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:36.407790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed0b59-1313-4d31-94fd-e7b5ed09533d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:36.451781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 842/1643] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:20:36.457041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e710db4-8753-4040-93d8-e0247e309842 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:36.470901 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e710db4-8753-4040-93d8-e0247e309842 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:36.503281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de280506-6a63-4732-bd3a-b55b92f550d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:36.503990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280506-6a63-4732-bd3a-b55b92f550d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.504322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280506-6a63-4732-bd3a-b55b92f550d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.505299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280506-6a63-4732-bd3a-b55b92f550d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.506112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de280506-6a63-4732-bd3a-b55b92f550d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:36.510278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de280506-6a63-4732-bd3a-b55b92f550d3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:36.589728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 802/1644] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:36 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:36.591850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed0b59-1313-4d31-94fd-e7b5ed09533d admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:36.615551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed0b59-1313-4d31-94fd-e7b5ed09533d admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:36.814604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55949a64-2fa4-46d0-a4f4-0f8a2887f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:36.815357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55949a64-2fa4-46d0-a4f4-0f8a2887f98f admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.830054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55949a64-2fa4-46d0-a4f4-0f8a2887f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.831954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55949a64-2fa4-46d0-a4f4-0f8a2887f98f admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.841184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55949a64-2fa4-46d0-a4f4-0f8a2887f98f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:36.851136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55949a64-2fa4-46d0-a4f4-0f8a2887f98f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:36.897848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:36.928485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 843/1645] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:36 2022] POST /identity/v3/users => generated 283 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:36.932790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de280506-6a63-4732-bd3a-b55b92f550d3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:36.953882 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de280506-6a63-4732-bd3a-b55b92f550d3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:36.970532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d73b-80e2-4903-8c18-d66f75a3f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:36.971222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d73b-80e2-4903-8c18-d66f75a3f33b admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.971503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d73b-80e2-4903-8c18-d66f75a3f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.971781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d73b-80e2-4903-8c18-d66f75a3f33b admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.972525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40d73b-80e2-4903-8c18-d66f75a3f33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:36.977585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40d73b-80e2-4903-8c18-d66f75a3f33b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:37.010028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 803/1646] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:37.012407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55949a64-2fa4-46d0-a4f4-0f8a2887f98f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.030400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55949a64-2fa4-46d0-a4f4-0f8a2887f98f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:37.043040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439c9c2-6915-4003-9997-bb0777217e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:37.043766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439c9c2-6915-4003-9997-bb0777217e9a admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:37.044052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439c9c2-6915-4003-9997-bb0777217e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:37.044349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439c9c2-6915-4003-9997-bb0777217e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:37.045209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439c9c2-6915-4003-9997-bb0777217e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:37.057162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439c9c2-6915-4003-9997-bb0777217e9a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:37.074828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 844/1647] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:37.078617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d73b-80e2-4903-8c18-d66f75a3f33b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.090234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d73b-80e2-4903-8c18-d66f75a3f33b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:37.110211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e083b8-d5ef-4d44-ab65-f513ab6a08ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:37.111136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e083b8-d5ef-4d44-ab65-f513ab6a08ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:37.111415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e083b8-d5ef-4d44-ab65-f513ab6a08ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:37.111707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e083b8-d5ef-4d44-ab65-f513ab6a08ed admin admin] PATH_INFO: `/v3/projects/040370d9de8f492f9fbe536dfdce089c/users/34c1946c04394466978ca81044b103c2/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:37.155715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e083b8-d5ef-4d44-ab65-f513ab6a08ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=040370d9de8f492f9fbe536dfdce089c, user_id=34c1946c04394466978ca81044b103c2, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:37.165885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e083b8-d5ef-4d44-ab65-f513ab6a08ed admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:37.198847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 804/1648] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:37 2022] PUT /identity/v3/projects/040370d9de8f492f9fbe536dfdce089c/users/34c1946c04394466978ca81044b103c2/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:37.213332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56fa09-ffa5-4fc1-a537-84faa4dac5f2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:37.213733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56fa09-ffa5-4fc1-a537-84faa4dac5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:37.214192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56fa09-ffa5-4fc1-a537-84faa4dac5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:37.266808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0b56fa09-ffa5-4fc1-a537-84faa4dac5f2 None None] MFA Rules not processed for user `34c1946c04394466978ca81044b103c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:37.274879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0b56fa09-ffa5-4fc1-a537-84faa4dac5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:37.427813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 845/1649] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:37.432621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e083b8-d5ef-4d44-ab65-f513ab6a08ed admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.537868 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e083b8-d5ef-4d44-ab65-f513ab6a08ed admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:37.545394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3204a2c-1569-4f21-a452-b512439a71e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:37.546156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3204a2c-1569-4f21-a452-b512439a71e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:37.546442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3204a2c-1569-4f21-a452-b512439a71e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:37.546762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3204a2c-1569-4f21-a452-b512439a71e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:37.547459 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3204a2c-1569-4f21-a452-b512439a71e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:37.551069 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3204a2c-1569-4f21-a452-b512439a71e0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:37.556460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:37.591445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 805/1650] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:37 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:37.595496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56fa09-ffa5-4fc1-a537-84faa4dac5f2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.618377 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56fa09-ffa5-4fc1-a537-84faa4dac5f2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:37.672959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3204a2c-1569-4f21-a452-b512439a71e0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.674174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a3204a2c-1569-4f21-a452-b512439a71e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:37.771584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca422695-4c02-441b-becb-db08e08e024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:37.772516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422695-4c02-441b-becb-db08e08e024e admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:37.772927 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422695-4c02-441b-becb-db08e08e024e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:37.773305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422695-4c02-441b-becb-db08e08e024e admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:37.774151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca422695-4c02-441b-becb-db08e08e024e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:37.777904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca422695-4c02-441b-becb-db08e08e024e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:37.831049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3204a2c-1569-4f21-a452-b512439a71e0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:37.831390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 846/1651] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:37 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:37.837382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca422695-4c02-441b-becb-db08e08e024e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.842396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:37.843864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:37.844308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:37.845386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] PATH_INFO: `/v3/users/560a544c56114d7a8da2eece7fba5e3a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:37.847041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560a544c56114d7a8da2eece7fba5e3a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:37.850660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:37.866243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca422695-4c02-441b-becb-db08e08e024e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:37.883279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab4592-240a-4af0-926f-11246b1b38dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:37.887606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4592-240a-4af0-926f-11246b1b38dc admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:37.887838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4592-240a-4af0-926f-11246b1b38dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:37.888324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4592-240a-4af0-926f-11246b1b38dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:37.892156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab4592-240a-4af0-926f-11246b1b38dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:37.894109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab4592-240a-4af0-926f-11246b1b38dc admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:37.918679 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 847/1652] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:37.923388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab4592-240a-4af0-926f-11246b1b38dc admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.938556 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560a544c56114d7a8da2eece7fba5e3a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.941383 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab4592-240a-4af0-926f-11246b1b38dc admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:37.951368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560a544c56114d7a8da2eece7fba5e3a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.953077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560a544c56114d7a8da2eece7fba5e3a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.958410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb37e46-0564-4f51-8821-8bc6042090c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:37.959654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb37e46-0564-4f51-8821-8bc6042090c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:37.960149 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb37e46-0564-4f51-8821-8bc6042090c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:37.960629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb37e46-0564-4f51-8821-8bc6042090c9 admin admin] PATH_INFO: `/v3/projects/f61beab5e733459e916caeb819cce60d/users/856531597db8467b92d476645dc1f444/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:37.978816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560a544c56114d7a8da2eece7fba5e3a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.983856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb37e46-0564-4f51-8821-8bc6042090c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61beab5e733459e916caeb819cce60d, user_id=856531597db8467b92d476645dc1f444, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:37.988055 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb37e46-0564-4f51-8821-8bc6042090c9 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:37.989086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d313d5a3-b7b5-43f9-902c-4fe03fefb1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560a544c56114d7a8da2eece7fba5e3a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.999752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 806/1653] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:37 2022] DELETE /identity/v3/users/560a544c56114d7a8da2eece7fba5e3a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:38.004961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae470f7-306e-4db1-8e1c-5f84facbb672 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.005330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae470f7-306e-4db1-8e1c-5f84facbb672 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.005625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae470f7-306e-4db1-8e1c-5f84facbb672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.010773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 848/1654] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:37 2022] PUT /identity/v3/projects/f61beab5e733459e916caeb819cce60d/users/856531597db8467b92d476645dc1f444/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:38.016490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb37e46-0564-4f51-8821-8bc6042090c9 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:38.023680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-feb37e46-0564-4f51-8821-8bc6042090c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:38.047070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5ae470f7-306e-4db1-8e1c-5f84facbb672 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:38.050094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5ae470f7-306e-4db1-8e1c-5f84facbb672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:38.099951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:38.181790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 807/1655] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:38.195852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb37e46-0564-4f51-8821-8bc6042090c9 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:38.204708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a308d7-7c10-497c-8529-4a41857ae5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:38.206091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a308d7-7c10-497c-8529-4a41857ae5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.206513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a308d7-7c10-497c-8529-4a41857ae5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.206877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a308d7-7c10-497c-8529-4a41857ae5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.207933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a308d7-7c10-497c-8529-4a41857ae5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:38.209992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a308d7-7c10-497c-8529-4a41857ae5f5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:38.234313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 849/1656] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:38.238458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae470f7-306e-4db1-8e1c-5f84facbb672 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:38.258035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:38.270398 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a308d7-7c10-497c-8529-4a41857ae5f5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:38.274996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-45a308d7-7c10-497c-8529-4a41857ae5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:38.277169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae470f7-306e-4db1-8e1c-5f84facbb672 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:38.292490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc520571-6387-46e8-834f-96d97c97ac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:38.305313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520571-6387-46e8-834f-96d97c97ac64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.306973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520571-6387-46e8-834f-96d97c97ac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.307583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520571-6387-46e8-834f-96d97c97ac64 admin admin] PATH_INFO: `/v3/projects/f61beab5e733459e916caeb819cce60d/users/856531597db8467b92d476645dc1f444/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.313589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc520571-6387-46e8-834f-96d97c97ac64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61beab5e733459e916caeb819cce60d, user_id=856531597db8467b92d476645dc1f444, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:38.316559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc520571-6387-46e8-834f-96d97c97ac64 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:38.356848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 808/1657] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:38 2022] PUT /identity/v3/projects/f61beab5e733459e916caeb819cce60d/users/856531597db8467b92d476645dc1f444/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:38.368477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8004c8-802a-41e1-bb1c-6e164e328a0c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.368876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8004c8-802a-41e1-bb1c-6e164e328a0c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.369518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8004c8-802a-41e1-bb1c-6e164e328a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.437108 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6c8004c8-802a-41e1-bb1c-6e164e328a0c None None] MFA Rules not processed for user `856531597db8467b92d476645dc1f444`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:38.439659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6c8004c8-802a-41e1-bb1c-6e164e328a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:38.451838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a308d7-7c10-497c-8529-4a41857ae5f5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:38.607561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2aee21-65d3-47b6-bed4-335507ce0d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:38.614574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aee21-65d3-47b6-bed4-335507ce0d5f service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.616676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aee21-65d3-47b6-bed4-335507ce0d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.618523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aee21-65d3-47b6-bed4-335507ce0d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.650693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 809/1658] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:38.656508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8004c8-802a-41e1-bb1c-6e164e328a0c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:38.658550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6c8004c8-802a-41e1-bb1c-6e164e328a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:38.819913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2aee21-65d3-47b6-bed4-335507ce0d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:38.824118 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2aee21-65d3-47b6-bed4-335507ce0d5f service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:38.844459 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8004c8-802a-41e1-bb1c-6e164e328a0c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:38.853676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb6c28-bcc3-4e19-934b-414bd129a34b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:38.854555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 850/1659] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:38.855857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb6c28-bcc3-4e19-934b-414bd129a34b service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.856975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb6c28-bcc3-4e19-934b-414bd129a34b service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.857412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb6c28-bcc3-4e19-934b-414bd129a34b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.873318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb6c28-bcc3-4e19-934b-414bd129a34b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:38.878585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb6c28-bcc3-4e19-934b-414bd129a34b service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:38.911667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 810/1660] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:39.144572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2aee21-65d3-47b6-bed4-335507ce0d5f service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:39.161203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2aee21-65d3-47b6-bed4-335507ce0d5f service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:39.167065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48cdf2-0593-4e1c-b5c8-823bc3be780b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:39.167897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cdf2-0593-4e1c-b5c8-823bc3be780b service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.171713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cdf2-0593-4e1c-b5c8-823bc3be780b service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.172115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cdf2-0593-4e1c-b5c8-823bc3be780b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.175914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0f48cdf2-0593-4e1c-b5c8-823bc3be780b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:39.222435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:39.275098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48cdf2-0593-4e1c-b5c8-823bc3be780b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:39.278147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48cdf2-0593-4e1c-b5c8-823bc3be780b service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:39.308801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 851/1661] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:39.532036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610381b-a5fe-4da5-bdf1-288534b02165 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.533088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610381b-a5fe-4da5-bdf1-288534b02165 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.533746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610381b-a5fe-4da5-bdf1-288534b02165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.574804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9610381b-a5fe-4da5-bdf1-288534b02165 None None] MFA Rules not processed for user `96d2a62272e248d3b11aca8737e22fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:39.576277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9610381b-a5fe-4da5-bdf1-288534b02165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:39.695566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 811/1662] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:39.701445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39404c-f770-4fd8-af0a-98e55dbb63ae None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.701879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39404c-f770-4fd8-af0a-98e55dbb63ae None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.702311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39404c-f770-4fd8-af0a-98e55dbb63ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.733969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-cd39404c-f770-4fd8-af0a-98e55dbb63ae None None] MFA Rules not processed for user `96d2a62272e248d3b11aca8737e22fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:39.741481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cd39404c-f770-4fd8-af0a-98e55dbb63ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:39.763805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 852/1663] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:39.777812 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610381b-a5fe-4da5-bdf1-288534b02165 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:39.779090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9610381b-a5fe-4da5-bdf1-288534b02165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:39.813986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:40.009939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610381b-a5fe-4da5-bdf1-288534b02165 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:40.016515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273014bb-dfb1-4bd3-92ea-d718c4abae71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:40.017207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273014bb-dfb1-4bd3-92ea-d718c4abae71 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:40.017506 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273014bb-dfb1-4bd3-92ea-d718c4abae71 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:40.017770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273014bb-dfb1-4bd3-92ea-d718c4abae71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:40.027486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273014bb-dfb1-4bd3-92ea-d718c4abae71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:40.030539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273014bb-dfb1-4bd3-92ea-d718c4abae71 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:40.043059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 812/1664] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:40.279321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39404c-f770-4fd8-af0a-98e55dbb63ae None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:40.281545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cd39404c-f770-4fd8-af0a-98e55dbb63ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:40.317496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39404c-f770-4fd8-af0a-98e55dbb63ae None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:40.331500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:40.332508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:40.332798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:40.333075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] PATH_INFO: `/v3/projects/9ca668ca0fd74d5b807f7f03038e4ac1` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:40.336118 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca668ca0fd74d5b807f7f03038e4ac1)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:40.338423 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:40.477257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca668ca0fd74d5b807f7f03038e4ac1', 'request_id': 'req-acd3d87e-724b-4f03-8f95-b61de605054d'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:40.495868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca668ca0fd74d5b807f7f03038e4ac1', 'request_id': 'req-acd3d87e-724b-4f03-8f95-b61de605054d'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:40.510772 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca668ca0fd74d5b807f7f03038e4ac1', 'request_id': 'req-acd3d87e-724b-4f03-8f95-b61de605054d'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:40.537447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] The token cache is being invalidate because project 9ca668ca0fd74d5b807f7f03038e4ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:40.537749 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:40.538633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acd3d87e-724b-4f03-8f95-b61de605054d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:40.546157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 853/1665] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:40 2022] DELETE /identity/v3/projects/9ca668ca0fd74d5b807f7f03038e4ac1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:40.553008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4b073-fe72-447d-b59a-f8b36f19db73 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:40.554051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4b073-fe72-447d-b59a-f8b36f19db73 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:40.554760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4b073-fe72-447d-b59a-f8b36f19db73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:40.602224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-05c4b073-fe72-447d-b59a-f8b36f19db73 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:40.603902 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-05c4b073-fe72-447d-b59a-f8b36f19db73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:40.780019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 813/1666] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:40.788352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130876e-2815-482d-a4d1-c35f1bbae19c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:40.788935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130876e-2815-482d-a4d1-c35f1bbae19c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:40.789425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130876e-2815-482d-a4d1-c35f1bbae19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:40.841084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d130876e-2815-482d-a4d1-c35f1bbae19c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:40.843246 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d130876e-2815-482d-a4d1-c35f1bbae19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:40.880527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 854/1667] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:40.885534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4b073-fe72-447d-b59a-f8b36f19db73 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:40.921650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4b073-fe72-447d-b59a-f8b36f19db73 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:40.938002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f02689-df32-47a0-995e-6b83f58c2ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:40.939278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f02689-df32-47a0-995e-6b83f58c2ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:40.940908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f02689-df32-47a0-995e-6b83f58c2ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:40.941410 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f02689-df32-47a0-995e-6b83f58c2ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:40.942796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f02689-df32-47a0-995e-6b83f58c2ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:40.943443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f02689-df32-47a0-995e-6b83f58c2ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:40.945691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f02689-df32-47a0-995e-6b83f58c2ea3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:40.963096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db91814-2937-4b39-83d0-e375be2bf476 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:40.963681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db91814-2937-4b39-83d0-e375be2bf476 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:40.964111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db91814-2937-4b39-83d0-e375be2bf476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:41.001549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 814/1668] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:41.005736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f02689-df32-47a0-995e-6b83f58c2ea3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:41.043168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-2db91814-2937-4b39-83d0-e375be2bf476 None None] MFA Rules not processed for user `a6ade7726b4346c38e0eb2755d91d1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:41.047704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2db91814-2937-4b39-83d0-e375be2bf476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:41.049175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f02689-df32-47a0-995e-6b83f58c2ea3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:41.069242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc5cee-c803-44b4-811d-87aac6854988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:41.070192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc5cee-c803-44b4-811d-87aac6854988 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:41.070713 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc5cee-c803-44b4-811d-87aac6854988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:41.071144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc5cee-c803-44b4-811d-87aac6854988 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:41.072006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc5cee-c803-44b4-811d-87aac6854988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:41.074191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc5cee-c803-44b4-811d-87aac6854988 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:41.172966 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 815/1669] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:41 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:41.174309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc5cee-c803-44b4-811d-87aac6854988 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:41.335167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 855/1670] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:41.455747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc5cee-c803-44b4-811d-87aac6854988 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:41.475130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff5232-d711-4fd7-a85e-65cc978b99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:41.475843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5232-d711-4fd7-a85e-65cc978b99c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:41.476134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5232-d711-4fd7-a85e-65cc978b99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:41.476401 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5232-d711-4fd7-a85e-65cc978b99c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:41.477125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff5232-d711-4fd7-a85e-65cc978b99c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:41.479253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff5232-d711-4fd7-a85e-65cc978b99c8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:41.506657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:41.546285 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 816/1671] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:41 2022] POST /identity/v3/users => generated 284 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:41.551196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db91814-2937-4b39-83d0-e375be2bf476 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:41.570210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db91814-2937-4b39-83d0-e375be2bf476 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:41.611339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97182a-2db6-41d3-9a6e-1353d8ccf67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:41.612074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97182a-2db6-41d3-9a6e-1353d8ccf67d admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:41.612364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97182a-2db6-41d3-9a6e-1353d8ccf67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:41.612669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97182a-2db6-41d3-9a6e-1353d8ccf67d admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:41.615240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97182a-2db6-41d3-9a6e-1353d8ccf67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:41.616920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97182a-2db6-41d3-9a6e-1353d8ccf67d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:41.651903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 856/1672] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:41.658619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff5232-d711-4fd7-a85e-65cc978b99c8 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:41.670410 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff5232-d711-4fd7-a85e-65cc978b99c8 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:41.684116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846443a4-52a7-4e0f-96a2-23a65834cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:41.685040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846443a4-52a7-4e0f-96a2-23a65834cd4e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:41.687112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846443a4-52a7-4e0f-96a2-23a65834cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:41.687450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846443a4-52a7-4e0f-96a2-23a65834cd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:41.688799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846443a4-52a7-4e0f-96a2-23a65834cd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:41.690437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846443a4-52a7-4e0f-96a2-23a65834cd4e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:41.710281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97182a-2db6-41d3-9a6e-1353d8ccf67d admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:41.717298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 817/1673] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:41.723185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97182a-2db6-41d3-9a6e-1353d8ccf67d admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:41.731185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b1ff-bc2f-4be0-9edd-2cc60bb842c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:41.732281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b1ff-bc2f-4be0-9edd-2cc60bb842c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:41.732574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b1ff-bc2f-4be0-9edd-2cc60bb842c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:41.732855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b1ff-bc2f-4be0-9edd-2cc60bb842c7 admin admin] PATH_INFO: `/v3/projects/021acf422cf84eccb8c09065a413df40/users/2330a59a0382482795b55d76b63d06fd/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:41.753682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:41.763913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b1ff-bc2f-4be0-9edd-2cc60bb842c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021acf422cf84eccb8c09065a413df40, user_id=2330a59a0382482795b55d76b63d06fd, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:41.771060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b1ff-bc2f-4be0-9edd-2cc60bb842c7 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:41.815983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a55a2-d37c-4b6c-9ecf-31be2be68074 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:41.816245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a55a2-d37c-4b6c-9ecf-31be2be68074 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:41.816529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a55a2-d37c-4b6c-9ecf-31be2be68074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:41.818111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 857/1674] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:41 2022] PUT /identity/v3/projects/021acf422cf84eccb8c09065a413df40/users/2330a59a0382482795b55d76b63d06fd/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:41.880590 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9f0a55a2-d37c-4b6c-9ecf-31be2be68074 None None] MFA Rules not processed for user `2330a59a0382482795b55d76b63d06fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:41.882735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9f0a55a2-d37c-4b6c-9ecf-31be2be68074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:42.125686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 818/1675] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:42.127967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b1ff-bc2f-4be0-9edd-2cc60bb842c7 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:42.132351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f826b1ff-bc2f-4be0-9edd-2cc60bb842c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:42.152333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83595-25bf-4222-a369-3865fed07bde None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:42.152622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83595-25bf-4222-a369-3865fed07bde None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:42.152904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83595-25bf-4222-a369-3865fed07bde None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:42.154316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 819/1676] 10.222.0.66 () {54 vars in 912 bytes} [Wed Jun 22 10:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:20:42.160853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec2d8-0afe-40ba-9422-4fb970ae3436 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:42.161141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec2d8-0afe-40ba-9422-4fb970ae3436 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:42.161415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec2d8-0afe-40ba-9422-4fb970ae3436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:42.304158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-dbfec2d8-0afe-40ba-9422-4fb970ae3436 None None] MFA Rules not processed for user `0afeafd76edb40289d715f81485fa7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:42.308223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dbfec2d8-0afe-40ba-9422-4fb970ae3436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:42.356899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b1ff-bc2f-4be0-9edd-2cc60bb842c7 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:42.371457 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18ced-9f30-4f72-9a5e-b5414685901d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:42.371853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18ced-9f30-4f72-9a5e-b5414685901d service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:42.372441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18ced-9f30-4f72-9a5e-b5414685901d service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:42.372729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18ced-9f30-4f72-9a5e-b5414685901d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:42.400626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c18ced-9f30-4f72-9a5e-b5414685901d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:42.402101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c18ced-9f30-4f72-9a5e-b5414685901d service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:42.429148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 858/1677] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:42.458488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 820/1678] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:20:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:42.720113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18ced-9f30-4f72-9a5e-b5414685901d service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:42.722408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-69c18ced-9f30-4f72-9a5e-b5414685901d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:42.752697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18ced-9f30-4f72-9a5e-b5414685901d service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:42.763194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cda85-ffae-4813-a4b2-390a0786a5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:42.765786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cda85-ffae-4813-a4b2-390a0786a5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:42.767062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cda85-ffae-4813-a4b2-390a0786a5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:42.767416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cda85-ffae-4813-a4b2-390a0786a5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:42.799192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cda85-ffae-4813-a4b2-390a0786a5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:42.804863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cda85-ffae-4813-a4b2-390a0786a5a7 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:42.821071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 859/1679] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:45.405003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c22b5a-5688-4bdd-b531-a330d97e29ff None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:45.405614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c22b5a-5688-4bdd-b531-a330d97e29ff None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:45.405691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c22b5a-5688-4bdd-b531-a330d97e29ff None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:45.407943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 821/1680] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:20:45.495437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3b852-8076-463a-ae81-9852b6277f4c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:45.496060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3b852-8076-463a-ae81-9852b6277f4c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:45.496240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3b852-8076-463a-ae81-9852b6277f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:45.578906 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-4be3b852-8076-463a-ae81-9852b6277f4c None None] MFA Rules not processed for user `9b257dee0ca3400f860ef9bd8c7a4e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:45.582416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4be3b852-8076-463a-ae81-9852b6277f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:45.710099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 860/1681] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:20:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:45.797698 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a7db7-3d19-4c30-94a6-c5896a79d99c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:45.798753 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a7db7-3d19-4c30-94a6-c5896a79d99c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:45.799572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a7db7-3d19-4c30-94a6-c5896a79d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:45.812374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92468-2d55-4589-87c4-fdd9de605ddb None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:45.812940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92468-2d55-4589-87c4-fdd9de605ddb None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:45.813743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92468-2d55-4589-87c4-fdd9de605ddb None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:45.818222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 861/1682] 10.222.0.66 () {54 vars in 960 bytes} [Wed Jun 22 10:20:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:20:45.838536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2958b6-7839-48d7-9537-8696b37597a3 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:45.839047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2958b6-7839-48d7-9537-8696b37597a3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:45.839589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2958b6-7839-48d7-9537-8696b37597a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:45.871433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-bf2958b6-7839-48d7-9537-8696b37597a3 None None] MFA Rules not processed for user `9b257dee0ca3400f860ef9bd8c7a4e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:45.872743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-bf2958b6-7839-48d7-9537-8696b37597a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:45.893767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-249a7db7-3d19-4c30-94a6-c5896a79d99c None None] MFA Rules not processed for user `60dbe36087e14f9e8bf885977b0e7426`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:45.894873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 862/1683] 10.222.0.66 () {58 vars in 1057 bytes} [Wed Jun 22 10:20:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:45.905277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-249a7db7-3d19-4c30-94a6-c5896a79d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:45.911678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2958b6-7839-48d7-9537-8696b37597a3 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:45.994081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2958b6-7839-48d7-9537-8696b37597a3 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:46.016981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645497c4-fd40-490c-b6e2-71b1635626fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:46.017640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645497c4-fd40-490c-b6e2-71b1635626fd service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:46.017923 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645497c4-fd40-490c-b6e2-71b1635626fd service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:46.019492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645497c4-fd40-490c-b6e2-71b1635626fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:46.041876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645497c4-fd40-490c-b6e2-71b1635626fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:46.054155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645497c4-fd40-490c-b6e2-71b1635626fd service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:46.084477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 863/1684] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:46.085594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645497c4-fd40-490c-b6e2-71b1635626fd service placement] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:46.087519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-645497c4-fd40-490c-b6e2-71b1635626fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:46.115908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645497c4-fd40-490c-b6e2-71b1635626fd service placement] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:46.116256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:46.124328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4430e-8db4-489c-bab4-3f417f84e097 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:46.124677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4430e-8db4-489c-bab4-3f417f84e097 service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:46.124970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4430e-8db4-489c-bab4-3f417f84e097 service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:46.125259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4430e-8db4-489c-bab4-3f417f84e097 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:46.129107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b4a4430e-8db4-489c-bab4-3f417f84e097 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:46.141612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 822/1685] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:46.158780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a7db7-3d19-4c30-94a6-c5896a79d99c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:46.159030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4430e-8db4-489c-bab4-3f417f84e097 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:46.160672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-249a7db7-3d19-4c30-94a6-c5896a79d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:46.169088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4430e-8db4-489c-bab4-3f417f84e097 service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:46.192803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 864/1686] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:46.387365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a7db7-3d19-4c30-94a6-c5896a79d99c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:46.427455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bdfe2-4c69-4375-b350-2c7ecfa4aae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:46.438770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bdfe2-4c69-4375-b350-2c7ecfa4aae3 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:46.439224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bdfe2-4c69-4375-b350-2c7ecfa4aae3 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:46.439492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bdfe2-4c69-4375-b350-2c7ecfa4aae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:46.480960 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bdfe2-4c69-4375-b350-2c7ecfa4aae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:46.482690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bdfe2-4c69-4375-b350-2c7ecfa4aae3 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:46.527742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 823/1687] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:47.819994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4430e-8db4-489c-bab4-3f417f84e097 service placement] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:47.822545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b4a4430e-8db4-489c-bab4-3f417f84e097 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:47.938446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:47.977124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4430e-8db4-489c-bab4-3f417f84e097 service placement] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:47.983189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:47.984643 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:47.985072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:47.985516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] PATH_INFO: `/v3/users/7c33111bb0b5448a97d8b56ae66889b9` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:47.987393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c33111bb0b5448a97d8b56ae66889b9)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:47.988681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: WARNING py.warnings [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:20:47.988681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: warnings.warn(msg) Jun 22 10:20:47.988681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: Jun 22 10:20:47.990446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:48.157229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c33111bb0b5448a97d8b56ae66889b9'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:48.159188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c33111bb0b5448a97d8b56ae66889b9'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:48.161242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c33111bb0b5448a97d8b56ae66889b9'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:48.238075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c33111bb0b5448a97d8b56ae66889b9'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:48.261204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-39de9706-d228-45d8-888f-49f247a4a3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c33111bb0b5448a97d8b56ae66889b9'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:48.294926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 865/1688] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:47 2022] DELETE /identity/v3/users/7c33111bb0b5448a97d8b56ae66889b9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:48.929404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bdfe2-4c69-4375-b350-2c7ecfa4aae3 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:48.950021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bdfe2-4c69-4375-b350-2c7ecfa4aae3 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:49.078188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96e2a3-543b-4c02-b5ea-ff28c270f801 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:49.078803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96e2a3-543b-4c02-b5ea-ff28c270f801 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:49.082185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96e2a3-543b-4c02-b5ea-ff28c270f801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:49.140975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:49.141883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:49.142164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:49.142437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] PATH_INFO: `/v3/projects/25884fee7daa4ddd8a0e20ffaf6be7ca` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:49.148028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25884fee7daa4ddd8a0e20ffaf6be7ca)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:49.150044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:49.174396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0f96e2a3-543b-4c02-b5ea-ff28c270f801 None None] MFA Rules not processed for user `595531abf958489795f2363026697a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:49.175766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0f96e2a3-543b-4c02-b5ea-ff28c270f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:49.295322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25884fee7daa4ddd8a0e20ffaf6be7ca', 'request_id': 'req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:49.313980 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25884fee7daa4ddd8a0e20ffaf6be7ca', 'request_id': 'req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:49.341587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25884fee7daa4ddd8a0e20ffaf6be7ca', 'request_id': 'req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:49.364410 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] The token cache is being invalidate because project 25884fee7daa4ddd8a0e20ffaf6be7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:49.369308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:49.371472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 866/1689] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:49.380503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:49.381618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96e2a3-543b-4c02-b5ea-ff28c270f801 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:49.383187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0f96e2a3-543b-4c02-b5ea-ff28c270f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:49.388465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 824/1690] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:48 2022] DELETE /identity/v3/projects/25884fee7daa4ddd8a0e20ffaf6be7ca => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:49.390891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:49.404268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:49.435899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:49.565451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:49.626323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be3d5-8301-41e3-9fe0-d1ca0dcd0ce9 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:49.628995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96e2a3-543b-4c02-b5ea-ff28c270f801 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:49.644066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:49.645880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:49.646413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:49.646952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] PATH_INFO: `/v3/users/a6ade7726b4346c38e0eb2755d91d1e4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:49.653001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ade7726b4346c38e0eb2755d91d1e4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:49.657614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:49.743571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ade7726b4346c38e0eb2755d91d1e4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:49.756723 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ade7726b4346c38e0eb2755d91d1e4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:49.757693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ade7726b4346c38e0eb2755d91d1e4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:49.783338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ade7726b4346c38e0eb2755d91d1e4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:49.793992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-686bfdb4-e7ed-4128-bdbe-6ff7f70d4fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ade7726b4346c38e0eb2755d91d1e4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:49.805066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 825/1691] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:49 2022] DELETE /identity/v3/users/a6ade7726b4346c38e0eb2755d91d1e4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:49.831562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94161c4-5843-4eee-a614-887f5944c052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:49.833842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94161c4-5843-4eee-a614-887f5944c052 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:49.834531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94161c4-5843-4eee-a614-887f5944c052 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:49.835413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94161c4-5843-4eee-a614-887f5944c052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:49.843674 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b94161c4-5843-4eee-a614-887f5944c052 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:50.014180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94161c4-5843-4eee-a614-887f5944c052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:50.018822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94161c4-5843-4eee-a614-887f5944c052 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:50.042557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 867/1692] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:50.126017 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3d91-0ffe-4545-a7ee-1e948be50dd7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:50.126600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3d91-0ffe-4545-a7ee-1e948be50dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:50.126806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3d91-0ffe-4545-a7ee-1e948be50dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:50.213062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f18c3d91-0ffe-4545-a7ee-1e948be50dd7 None None] MFA Rules not processed for user `da80b9a52feb462faf0469f2ab701fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:50.220292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f18c3d91-0ffe-4545-a7ee-1e948be50dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:50.455559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 826/1693] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:50.462098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94161c4-5843-4eee-a614-887f5944c052 service nova] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:50.464474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b94161c4-5843-4eee-a614-887f5944c052 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:50.513983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94161c4-5843-4eee-a614-887f5944c052 service nova] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:50.751660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ef53-ecfb-4c24-a05b-2715f42e2ba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:50.752360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ef53-ecfb-4c24-a05b-2715f42e2ba1 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:50.752645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ef53-ecfb-4c24-a05b-2715f42e2ba1 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:50.752923 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ef53-ecfb-4c24-a05b-2715f42e2ba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:50.807427 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112ef53-ecfb-4c24-a05b-2715f42e2ba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:50.809112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112ef53-ecfb-4c24-a05b-2715f42e2ba1 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:50.844765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 868/1694] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:52.500106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84389457-d9ac-47aa-81a7-564b5bbce297 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:52.500106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84389457-d9ac-47aa-81a7-564b5bbce297 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:52.500106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84389457-d9ac-47aa-81a7-564b5bbce297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:52.566841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-84389457-d9ac-47aa-81a7-564b5bbce297 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:52.572514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-84389457-d9ac-47aa-81a7-564b5bbce297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:52.633912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:52.781318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 827/1695] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:53.075375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ef53-ecfb-4c24-a05b-2715f42e2ba1 service nova] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:53.077057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c112ef53-ecfb-4c24-a05b-2715f42e2ba1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:53.102664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:53.150106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84389457-d9ac-47aa-81a7-564b5bbce297 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:53.152064 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-84389457-d9ac-47aa-81a7-564b5bbce297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:53.286772 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ef53-ecfb-4c24-a05b-2715f42e2ba1 service nova] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:53.308455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77e086-88a9-4772-9136-24f52e118b44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:53.310837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e086-88a9-4772-9136-24f52e118b44 service swift] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:53.312900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e086-88a9-4772-9136-24f52e118b44 service swift] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:53.313987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e086-88a9-4772-9136-24f52e118b44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:53.360228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84389457-d9ac-47aa-81a7-564b5bbce297 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:53.375258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:53.377761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:53.377969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:53.380147 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] PATH_INFO: `/v3/projects/10aa2a33ce6e47b9b247f887215977b3` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:53.381167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77e086-88a9-4772-9136-24f52e118b44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:53.383752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10aa2a33ce6e47b9b247f887215977b3)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:53.385429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77e086-88a9-4772-9136-24f52e118b44 service swift] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:53.389365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:53.425844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 869/1696] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:20:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:20:53.436403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f6be6-87c1-4a61-be64-ae10e666ac19 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:53.447045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f6be6-87c1-4a61-be64-ae10e666ac19 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:53.447610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f6be6-87c1-4a61-be64-ae10e666ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:53.522253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-743f6be6-87c1-4a61-be64-ae10e666ac19 None None] MFA Rules not processed for user `60dbe36087e14f9e8bf885977b0e7426`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:53.528699 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-743f6be6-87c1-4a61-be64-ae10e666ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:53.619910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10aa2a33ce6e47b9b247f887215977b3', 'request_id': 'req-a95cb7b4-38a5-4a95-8206-4dc747ff5825'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:53.647510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10aa2a33ce6e47b9b247f887215977b3', 'request_id': 'req-a95cb7b4-38a5-4a95-8206-4dc747ff5825'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:53.685627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10aa2a33ce6e47b9b247f887215977b3', 'request_id': 'req-a95cb7b4-38a5-4a95-8206-4dc747ff5825'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:53.693454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 870/1697] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:53.746648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] The token cache is being invalidate because project 10aa2a33ce6e47b9b247f887215977b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:53.750099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:53.754250 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a95cb7b4-38a5-4a95-8206-4dc747ff5825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:53.762683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 828/1698] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:53 2022] DELETE /identity/v3/projects/10aa2a33ce6e47b9b247f887215977b3 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:53.767671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618ab0-c5e2-40a4-ba13-0ba3f7b99ddb None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:53.767975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618ab0-c5e2-40a4-ba13-0ba3f7b99ddb None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:53.768222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618ab0-c5e2-40a4-ba13-0ba3f7b99ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:53.822618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-77618ab0-c5e2-40a4-ba13-0ba3f7b99ddb None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:53.823882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-77618ab0-c5e2-40a4-ba13-0ba3f7b99ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:53.980946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 871/1699] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:53.989529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a22997-42d9-4e72-b813-961070489a00 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:53.989821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a22997-42d9-4e72-b813-961070489a00 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:53.990097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a22997-42d9-4e72-b813-961070489a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:54.100023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c1a22997-42d9-4e72-b813-961070489a00 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:54.102204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c1a22997-42d9-4e72-b813-961070489a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:54.137665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 829/1700] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:54.147995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77618ab0-c5e2-40a4-ba13-0ba3f7b99ddb None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:54.162037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77618ab0-c5e2-40a4-ba13-0ba3f7b99ddb None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:54.174563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541910e6-6e1a-4b05-bb2c-bae3e142271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:54.175248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541910e6-6e1a-4b05-bb2c-bae3e142271c admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.175534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541910e6-6e1a-4b05-bb2c-bae3e142271c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.175817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541910e6-6e1a-4b05-bb2c-bae3e142271c admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:54.176568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541910e6-6e1a-4b05-bb2c-bae3e142271c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:54.176886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541910e6-6e1a-4b05-bb2c-bae3e142271c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:54.178593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541910e6-6e1a-4b05-bb2c-bae3e142271c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:54.211185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 872/1701] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:54.216013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a22997-42d9-4e72-b813-961070489a00 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:54.228740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a22997-42d9-4e72-b813-961070489a00 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:54.244293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49f2e8-4a96-41b4-9f9e-470538c1108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:54.244993 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49f2e8-4a96-41b4-9f9e-470538c1108a admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.245277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49f2e8-4a96-41b4-9f9e-470538c1108a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.248260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49f2e8-4a96-41b4-9f9e-470538c1108a admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:54.248260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49f2e8-4a96-41b4-9f9e-470538c1108a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:54.252743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49f2e8-4a96-41b4-9f9e-470538c1108a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:54.307071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 830/1702] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:54 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:54.308656 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541910e6-6e1a-4b05-bb2c-bae3e142271c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:54.320563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541910e6-6e1a-4b05-bb2c-bae3e142271c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:54.418633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:54.565281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a505670-a65e-4885-9cdc-735365206105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:54.567257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505670-a65e-4885-9cdc-735365206105 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.567547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505670-a65e-4885-9cdc-735365206105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.567824 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505670-a65e-4885-9cdc-735365206105 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:54.568569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a505670-a65e-4885-9cdc-735365206105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:54.581746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a505670-a65e-4885-9cdc-735365206105 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:54.669619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49f2e8-4a96-41b4-9f9e-470538c1108a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:54.676468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 873/1703] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:54 2022] POST /identity/v3/users => generated 283 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:54.707235 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49f2e8-4a96-41b4-9f9e-470538c1108a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:54.725158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b975230-e843-4e8f-bdda-9babe57a433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:54.735832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b975230-e843-4e8f-bdda-9babe57a433d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.736527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b975230-e843-4e8f-bdda-9babe57a433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.737653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b975230-e843-4e8f-bdda-9babe57a433d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:54.738679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b975230-e843-4e8f-bdda-9babe57a433d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:54.740412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b975230-e843-4e8f-bdda-9babe57a433d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:54.813553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a505670-a65e-4885-9cdc-735365206105 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:54.822957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 831/1704] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:54.828752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a505670-a65e-4885-9cdc-735365206105 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:54.863057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd1f6c-c09a-4d31-bd7e-4d1977427c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:54.863810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd1f6c-c09a-4d31-bd7e-4d1977427c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.864101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd1f6c-c09a-4d31-bd7e-4d1977427c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.864439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd1f6c-c09a-4d31-bd7e-4d1977427c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:54.865207 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd1f6c-c09a-4d31-bd7e-4d1977427c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:54.873935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd1f6c-c09a-4d31-bd7e-4d1977427c8c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:54.925980 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b975230-e843-4e8f-bdda-9babe57a433d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:54.933735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 874/1705] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:54.952656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b975230-e843-4e8f-bdda-9babe57a433d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:54.973450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8d0c4-3746-478a-992c-9de48aa5d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:54.974472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8d0c4-3746-478a-992c-9de48aa5d2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.974988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8d0c4-3746-478a-992c-9de48aa5d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.975416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8d0c4-3746-478a-992c-9de48aa5d2ae admin admin] PATH_INFO: `/v3/projects/c4cecb6d6de64964b95bdb7b58ffac0c/users/52361f3b7cb04622b487981224367b17/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.024989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:55.037727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8d0c4-3746-478a-992c-9de48aa5d2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4cecb6d6de64964b95bdb7b58ffac0c, user_id=52361f3b7cb04622b487981224367b17, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.047712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8d0c4-3746-478a-992c-9de48aa5d2ae admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:55.131394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7e499-0c5e-4fb7-a13f-fa2c342dd6cb None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.131739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7e499-0c5e-4fb7-a13f-fa2c342dd6cb None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.132024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7e499-0c5e-4fb7-a13f-fa2c342dd6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.138622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 832/1706] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:54 2022] PUT /identity/v3/projects/c4cecb6d6de64964b95bdb7b58ffac0c/users/52361f3b7cb04622b487981224367b17/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:55.267380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-5ea7e499-0c5e-4fb7-a13f-fa2c342dd6cb None None] MFA Rules not processed for user `52361f3b7cb04622b487981224367b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:55.291252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5ea7e499-0c5e-4fb7-a13f-fa2c342dd6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:55.602459 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8d0c4-3746-478a-992c-9de48aa5d2ae admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.607644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 875/1707] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:55.763796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8d0c4-3746-478a-992c-9de48aa5d2ae admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:55.771553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467ecec-7024-4cd9-bb89-cc9d7994fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:55.772952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467ecec-7024-4cd9-bb89-cc9d7994fd16 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.773474 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467ecec-7024-4cd9-bb89-cc9d7994fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.773982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467ecec-7024-4cd9-bb89-cc9d7994fd16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.775036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467ecec-7024-4cd9-bb89-cc9d7994fd16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.777260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467ecec-7024-4cd9-bb89-cc9d7994fd16 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:55.888136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 833/1708] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:55 2022] POST /identity/v3/projects => generated 365 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:55.889667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7e499-0c5e-4fb7-a13f-fa2c342dd6cb None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.913428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7e499-0c5e-4fb7-a13f-fa2c342dd6cb None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.084746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18910a4e-f244-43ec-8041-080b1b07b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.087087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910a4e-f244-43ec-8041-080b1b07b760 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.087831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910a4e-f244-43ec-8041-080b1b07b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.089208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910a4e-f244-43ec-8041-080b1b07b760 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.092472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18910a4e-f244-43ec-8041-080b1b07b760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.098604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18910a4e-f244-43ec-8041-080b1b07b760 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.166582 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467ecec-7024-4cd9-bb89-cc9d7994fd16 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.175685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 876/1709] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:55 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:56.191386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467ecec-7024-4cd9-bb89-cc9d7994fd16 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.208618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc96e6e-5ba5-4668-8318-7b70e8017a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.209320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc96e6e-5ba5-4668-8318-7b70e8017a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.209622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc96e6e-5ba5-4668-8318-7b70e8017a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.211861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc96e6e-5ba5-4668-8318-7b70e8017a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.212944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc96e6e-5ba5-4668-8318-7b70e8017a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.220274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc96e6e-5ba5-4668-8318-7b70e8017a75 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.276969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 834/1710] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:56.283267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18910a4e-f244-43ec-8041-080b1b07b760 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.300118 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18910a4e-f244-43ec-8041-080b1b07b760 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.316891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5282b8a-97bf-4765-9839-2b02f35df56a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.317177 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5282b8a-97bf-4765-9839-2b02f35df56a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.317452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5282b8a-97bf-4765-9839-2b02f35df56a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.339449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 835/1711] 10.222.0.66 () {54 vars in 912 bytes} [Wed Jun 22 10:20:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:20:56.339449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c776-5628-4365-8bb1-3bc7eb502644 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.339791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700eef7-927f-4aa0-b53c-51221b1bfda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.339791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700eef7-927f-4aa0-b53c-51221b1bfda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.339791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700eef7-927f-4aa0-b53c-51221b1bfda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.339791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700eef7-927f-4aa0-b53c-51221b1bfda0 admin admin] PATH_INFO: `/v3/projects/848a6c23cf0745f685b6629b9fa20ae4/users/1e48e9a4d6e84ddd8f91e08775df9aeb/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.340104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c776-5628-4365-8bb1-3bc7eb502644 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.340104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c776-5628-4365-8bb1-3bc7eb502644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.403348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700eef7-927f-4aa0-b53c-51221b1bfda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848a6c23cf0745f685b6629b9fa20ae4, user_id=1e48e9a4d6e84ddd8f91e08775df9aeb, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.409727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700eef7-927f-4aa0-b53c-51221b1bfda0 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.411819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-90b4c776-5628-4365-8bb1-3bc7eb502644 None None] MFA Rules not processed for user `0afeafd76edb40289d715f81485fa7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:56.413166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-90b4c776-5628-4365-8bb1-3bc7eb502644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:56.448042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 877/1712] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:56 2022] PUT /identity/v3/projects/848a6c23cf0745f685b6629b9fa20ae4/users/1e48e9a4d6e84ddd8f91e08775df9aeb/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:56.451848 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700eef7-927f-4aa0-b53c-51221b1bfda0 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.488397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:56.637517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 836/1713] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:56.671143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c776-5628-4365-8bb1-3bc7eb502644 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.672638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-90b4c776-5628-4365-8bb1-3bc7eb502644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:56.694915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c776-5628-4365-8bb1-3bc7eb502644 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.699603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700eef7-927f-4aa0-b53c-51221b1bfda0 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.721961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f90a0d-4490-4c7d-acc7-41dc6b3ee00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.722760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f90a0d-4490-4c7d-acc7-41dc6b3ee00a admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.723051 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f90a0d-4490-4c7d-acc7-41dc6b3ee00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.723416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f90a0d-4490-4c7d-acc7-41dc6b3ee00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.724281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f90a0d-4490-4c7d-acc7-41dc6b3ee00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.734873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f90a0d-4490-4c7d-acc7-41dc6b3ee00a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.797472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 878/1714] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:56.798680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f90a0d-4490-4c7d-acc7-41dc6b3ee00a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.844719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f90a0d-4490-4c7d-acc7-41dc6b3ee00a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.867613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a858b-7e6b-426d-923e-51bfd9bae6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.868780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a858b-7e6b-426d-923e-51bfd9bae6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.869095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a858b-7e6b-426d-923e-51bfd9bae6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.869412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a858b-7e6b-426d-923e-51bfd9bae6b2 admin admin] PATH_INFO: `/v3/projects/848a6c23cf0745f685b6629b9fa20ae4/users/1e48e9a4d6e84ddd8f91e08775df9aeb/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.912821 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a858b-7e6b-426d-923e-51bfd9bae6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848a6c23cf0745f685b6629b9fa20ae4, user_id=1e48e9a4d6e84ddd8f91e08775df9aeb, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.927096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a858b-7e6b-426d-923e-51bfd9bae6b2 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.959402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8f78f-111e-4d6a-a353-61aee1cbeb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.960091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f78f-111e-4d6a-a353-61aee1cbeb1d service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.960552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f78f-111e-4d6a-a353-61aee1cbeb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.960983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f78f-111e-4d6a-a353-61aee1cbeb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.973095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 879/1715] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:56 2022] PUT /identity/v3/projects/848a6c23cf0745f685b6629b9fa20ae4/users/1e48e9a4d6e84ddd8f91e08775df9aeb/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:56.995613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f78f-111e-4d6a-a353-61aee1cbeb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.997162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f78f-111e-4d6a-a353-61aee1cbeb1d service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.998531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3bf9-1d27-4def-a3d5-c58fe3027d6d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.998859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3bf9-1d27-4def-a3d5-c58fe3027d6d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.999149 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3bf9-1d27-4def-a3d5-c58fe3027d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.041245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 837/1716] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:57.117517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8f78f-111e-4d6a-a353-61aee1cbeb1d service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:57.119019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-44c8f78f-111e-4d6a-a353-61aee1cbeb1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.147898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0d1c3bf9-1d27-4def-a3d5-c58fe3027d6d None None] MFA Rules not processed for user `1e48e9a4d6e84ddd8f91e08775df9aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:57.149010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0d1c3bf9-1d27-4def-a3d5-c58fe3027d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.160104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8f78f-111e-4d6a-a353-61aee1cbeb1d service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:57.209083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:57.356368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:57.357830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.358973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.359362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] PATH_INFO: `/v3/users/34c1946c04394466978ca81044b103c2` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.364052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c1946c04394466978ca81044b103c2)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:57.365616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 880/1717] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:57.368106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:57.382799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c3bf9-1d27-4def-a3d5-c58fe3027d6d None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:57.385011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0d1c3bf9-1d27-4def-a3d5-c58fe3027d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.588773 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c1946c04394466978ca81044b103c2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:57.604938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c1946c04394466978ca81044b103c2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:57.608010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c1946c04394466978ca81044b103c2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:57.645678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c3bf9-1d27-4def-a3d5-c58fe3027d6d None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:57.661216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c1946c04394466978ca81044b103c2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:57.663585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b5b16-7a72-4b7d-a6a5-eacd9fbc2e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:57.666382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b5b16-7a72-4b7d-a6a5-eacd9fbc2e59 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.669435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b5b16-7a72-4b7d-a6a5-eacd9fbc2e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.675459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b5b16-7a72-4b7d-a6a5-eacd9fbc2e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.685216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-922b5b16-7a72-4b7d-a6a5-eacd9fbc2e59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.710494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8e39f40a-289a-4a82-8641-945973e22b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c1946c04394466978ca81044b103c2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:57.724665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 838/1718] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:57 2022] DELETE /identity/v3/users/34c1946c04394466978ca81044b103c2 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:57.748200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78e62-9875-45cd-b525-8162df98250d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.748694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78e62-9875-45cd-b525-8162df98250d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.749063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b5b16-7a72-4b7d-a6a5-eacd9fbc2e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:57.749251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78e62-9875-45cd-b525-8162df98250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.752574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b5b16-7a72-4b7d-a6a5-eacd9fbc2e59 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:57.780330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 881/1719] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:57.826644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d2f78e62-9875-45cd-b525-8162df98250d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:57.826989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96602-9fec-4bf5-8189-9566618e4752 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.827506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96602-9fec-4bf5-8189-9566618e4752 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.827909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96602-9fec-4bf5-8189-9566618e4752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.831117 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d2f78e62-9875-45cd-b525-8162df98250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.936684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b8c96602-9fec-4bf5-8189-9566618e4752 None None] MFA Rules not processed for user `0afeafd76edb40289d715f81485fa7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:57.940767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b8c96602-9fec-4bf5-8189-9566618e4752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.011325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:58.148155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 839/1720] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:58.183889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f78e62-9875-45cd-b525-8162df98250d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:58.188813 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d2f78e62-9875-45cd-b525-8162df98250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.194660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 882/1721] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Jun 22 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:58.225008 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c96602-9fec-4bf5-8189-9566618e4752 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:58.250147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c96602-9fec-4bf5-8189-9566618e4752 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:58.264985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f78e62-9875-45cd-b525-8162df98250d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:58.268025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ceddc-9e02-46ad-b633-2e7765790294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:58.268717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ceddc-9e02-46ad-b633-2e7765790294 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.269046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ceddc-9e02-46ad-b633-2e7765790294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.269327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ceddc-9e02-46ad-b633-2e7765790294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.297198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ceddc-9e02-46ad-b633-2e7765790294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:58.298825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ceddc-9e02-46ad-b633-2e7765790294 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:58.324820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 883/1722] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:58.347681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb29b3-a0f8-4fec-8ab6-93f8dacc5a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:58.352245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb29b3-a0f8-4fec-8ab6-93f8dacc5a43 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.352531 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb29b3-a0f8-4fec-8ab6-93f8dacc5a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.352811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb29b3-a0f8-4fec-8ab6-93f8dacc5a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.410621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb29b3-a0f8-4fec-8ab6-93f8dacc5a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:58.414772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb29b3-a0f8-4fec-8ab6-93f8dacc5a43 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:58.447738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 840/1723] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:58.611126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f637aa-4a24-40ab-af46-2a11a4d75626 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.612143 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f637aa-4a24-40ab-af46-2a11a4d75626 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.614583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f637aa-4a24-40ab-af46-2a11a4d75626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.678398 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-08f637aa-4a24-40ab-af46-2a11a4d75626 None None] MFA Rules not processed for user `595531abf958489795f2363026697a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:58.680024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-08f637aa-4a24-40ab-af46-2a11a4d75626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.828030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341ebe3-089c-4b4c-97fb-cdc2cac6588f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.828336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341ebe3-089c-4b4c-97fb-cdc2cac6588f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.829350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341ebe3-089c-4b4c-97fb-cdc2cac6588f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.908779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 884/1724] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:58.916299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f637aa-4a24-40ab-af46-2a11a4d75626 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:58.920267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-08f637aa-4a24-40ab-af46-2a11a4d75626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.933376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8341ebe3-089c-4b4c-97fb-cdc2cac6588f None None] MFA Rules not processed for user `8fc916f852f4433eac4a3a2a12384834`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:58.936045 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8341ebe3-089c-4b4c-97fb-cdc2cac6588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.959235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f637aa-4a24-40ab-af46-2a11a4d75626 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:58.963263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:58.974012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:58.978745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.979356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.979819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] PATH_INFO: `/v3/users/52361f3b7cb04622b487981224367b17` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.985320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52361f3b7cb04622b487981224367b17)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:58.990255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:59.138268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52361f3b7cb04622b487981224367b17'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.139885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52361f3b7cb04622b487981224367b17'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.142025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52361f3b7cb04622b487981224367b17'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.171780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 841/1725] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:59.187227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f661b5e-54fe-4b94-a11d-9e09530eb828 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:59.190721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f661b5e-54fe-4b94-a11d-9e09530eb828 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:59.191067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f661b5e-54fe-4b94-a11d-9e09530eb828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:59.210463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52361f3b7cb04622b487981224367b17'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.234485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52361f3b7cb04622b487981224367b17'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.252259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0f661b5e-54fe-4b94-a11d-9e09530eb828 None None] MFA Rules not processed for user `8fc916f852f4433eac4a3a2a12384834`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:59.253554 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0f661b5e-54fe-4b94-a11d-9e09530eb828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:59.296317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 842/1726] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:59.306259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 885/1727] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:58 2022] DELETE /identity/v3/users/52361f3b7cb04622b487981224367b17 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:59.308062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d1b5-b8c6-4ed0-85c4-0035cb4580b1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:59.308371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d1b5-b8c6-4ed0-85c4-0035cb4580b1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:59.308644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d1b5-b8c6-4ed0-85c4-0035cb4580b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:59.373568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-11f6d1b5-b8c6-4ed0-85c4-0035cb4580b1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:59.378694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-11f6d1b5-b8c6-4ed0-85c4-0035cb4580b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:59.668166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 843/1728] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:59.745820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:59.748910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:59.752294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6d1b5-b8c6-4ed0-85c4-0035cb4580b1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:59.755509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-11f6d1b5-b8c6-4ed0-85c4-0035cb4580b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:59.888909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:00.023557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0b231-a7f8-486d-890c-051c3e230513 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:00.035604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cd1a4-18ae-4813-a17b-d1cbf36f4257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:00.036636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cd1a4-18ae-4813-a17b-d1cbf36f4257 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:00.037148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cd1a4-18ae-4813-a17b-d1cbf36f4257 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:00.038115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cd1a4-18ae-4813-a17b-d1cbf36f4257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:00.042011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a40cd1a4-18ae-4813-a17b-d1cbf36f4257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:00.081923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6d1b5-b8c6-4ed0-85c4-0035cb4580b1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:00.128493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3adb95-d325-4024-b4f6-7f52b903d5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:00.129272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3adb95-d325-4024-b4f6-7f52b903d5ec service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:00.129559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3adb95-d325-4024-b4f6-7f52b903d5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:00.129844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3adb95-d325-4024-b4f6-7f52b903d5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:00.208546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3adb95-d325-4024-b4f6-7f52b903d5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:00.217031 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3adb95-d325-4024-b4f6-7f52b903d5ec service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:00.268651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cd1a4-18ae-4813-a17b-d1cbf36f4257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:00.275600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cd1a4-18ae-4813-a17b-d1cbf36f4257 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:00.276891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 844/1729] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:00.320277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 886/1730] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:02.220083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f4ff6-1fd0-4bd0-8a32-d1667d31dc0a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:02.220687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f4ff6-1fd0-4bd0-8a32-d1667d31dc0a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:02.220687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f4ff6-1fd0-4bd0-8a32-d1667d31dc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:02.285038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b54f4ff6-1fd0-4bd0-8a32-d1667d31dc0a None None] MFA Rules not processed for user `da80b9a52feb462faf0469f2ab701fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:02.286220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b54f4ff6-1fd0-4bd0-8a32-d1667d31dc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:02.429412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cd1a4-18ae-4813-a17b-d1cbf36f4257 service nova] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:02.433012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a40cd1a4-18ae-4813-a17b-d1cbf36f4257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:02.477474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cd1a4-18ae-4813-a17b-d1cbf36f4257 service nova] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:02.492086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:02.505816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:02.507053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:02.511482 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:02.512347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] PATH_INFO: `/v3/users/2330a59a0382482795b55d76b63d06fd` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:02.515687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2330a59a0382482795b55d76b63d06fd)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:02.526918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:02.550229 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 845/1731] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:02.560419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa880-71b8-4938-90d7-3db73f4dd6ab None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:02.561925 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa880-71b8-4938-90d7-3db73f4dd6ab None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:02.562411 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa880-71b8-4938-90d7-3db73f4dd6ab None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:02.567171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 846/1732] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:21:02 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:21:02.706736 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2330a59a0382482795b55d76b63d06fd'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:02.707716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2330a59a0382482795b55d76b63d06fd'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:02.709741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2330a59a0382482795b55d76b63d06fd'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:02.774202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2330a59a0382482795b55d76b63d06fd'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:02.790602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-16cf6ea9-6592-4e76-b6a3-2583b5451b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2330a59a0382482795b55d76b63d06fd'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:02.839843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fe5fd-de3f-4f22-8118-ffa70a204788 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:02.840272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fe5fd-de3f-4f22-8118-ffa70a204788 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:02.841088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fe5fd-de3f-4f22-8118-ffa70a204788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:02.843279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 887/1733] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:02 2022] DELETE /identity/v3/users/2330a59a0382482795b55d76b63d06fd => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:02.848355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ce62-09be-494a-a23c-15c478c0ec3b None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:02.848642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ce62-09be-494a-a23c-15c478c0ec3b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:02.848938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ce62-09be-494a-a23c-15c478c0ec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:02.921740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-eb5fe5fd-de3f-4f22-8118-ffa70a204788 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:02.926906 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eb5fe5fd-de3f-4f22-8118-ffa70a204788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:02.943335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-5487ce62-09be-494a-a23c-15c478c0ec3b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:02.946174 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5487ce62-09be-494a-a23c-15c478c0ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:03.076667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:03.183413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 888/1734] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:03.187821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 847/1735] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:21:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:03.188962 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487ce62-09be-494a-a23c-15c478c0ec3b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:03.193933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5487ce62-09be-494a-a23c-15c478c0ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:03.234726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487ce62-09be-494a-a23c-15c478c0ec3b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:03.257059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:03.258811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:03.258811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:03.258811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] PATH_INFO: `/v3/projects/c4cecb6d6de64964b95bdb7b58ffac0c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:03.266228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4cecb6d6de64964b95bdb7b58ffac0c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:03.269700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:03.292244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fe5fd-de3f-4f22-8118-ffa70a204788 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:03.294049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eb5fe5fd-de3f-4f22-8118-ffa70a204788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:03.493137 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4cecb6d6de64964b95bdb7b58ffac0c', 'request_id': 'req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:03.517310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4cecb6d6de64964b95bdb7b58ffac0c', 'request_id': 'req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:03.544167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fe5fd-de3f-4f22-8118-ffa70a204788 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:03.553169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4cecb6d6de64964b95bdb7b58ffac0c', 'request_id': 'req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:03.639820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] The token cache is being invalidate because project c4cecb6d6de64964b95bdb7b58ffac0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:03.642676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:03.646486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:03.663752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 889/1736] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:03 2022] DELETE /identity/v3/projects/c4cecb6d6de64964b95bdb7b58ffac0c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:03.665833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:03.682771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:03.756884 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87454e-7d23-483b-996c-882df4fbc319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:03.758110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87454e-7d23-483b-996c-882df4fbc319 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:03.758685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87454e-7d23-483b-996c-882df4fbc319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:03.759326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87454e-7d23-483b-996c-882df4fbc319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:03.765551 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-db87454e-7d23-483b-996c-882df4fbc319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:03.972391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:04.015719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87454e-7d23-483b-996c-882df4fbc319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:04.017744 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87454e-7d23-483b-996c-882df4fbc319 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:04.057000 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 848/1737] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:04.058145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87454e-7d23-483b-996c-882df4fbc319 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:04.061689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-db87454e-7d23-483b-996c-882df4fbc319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:04.095532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87454e-7d23-483b-996c-882df4fbc319 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:04.101791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:04.104475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:04.110495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:04.112223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] PATH_INFO: `/v3/users/1e48e9a4d6e84ddd8f91e08775df9aeb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:04.114022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e48e9a4d6e84ddd8f91e08775df9aeb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:04.123338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:04.154333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a6a8-8f56-487b-bc57-d280e2dbfa2a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:04.189142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:04.191635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:04.191951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:04.192236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] PATH_INFO: `/v3/projects/040370d9de8f492f9fbe536dfdce089c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:04.202749 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=040370d9de8f492f9fbe536dfdce089c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:04.219591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:04.345706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e48e9a4d6e84ddd8f91e08775df9aeb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:04.371798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e48e9a4d6e84ddd8f91e08775df9aeb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:04.372824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e48e9a4d6e84ddd8f91e08775df9aeb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:04.424319 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e48e9a4d6e84ddd8f91e08775df9aeb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:04.457458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e48e9a4d6e84ddd8f91e08775df9aeb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:04.486638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 849/1738] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:04 2022] DELETE /identity/v3/users/1e48e9a4d6e84ddd8f91e08775df9aeb => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:04.488845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:04.494536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:04.513971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040370d9de8f492f9fbe536dfdce089c', 'request_id': 'req-4318b291-8f0e-491d-a8e1-261a8eadd74a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:04.542085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040370d9de8f492f9fbe536dfdce089c', 'request_id': 'req-4318b291-8f0e-491d-a8e1-261a8eadd74a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:04.564538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040370d9de8f492f9fbe536dfdce089c', 'request_id': 'req-4318b291-8f0e-491d-a8e1-261a8eadd74a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:04.585325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:04.631233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] The token cache is being invalidate because project 040370d9de8f492f9fbe536dfdce089c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:04.634119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:04.635672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4318b291-8f0e-491d-a8e1-261a8eadd74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:04.643315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 890/1739] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:03 2022] DELETE /identity/v3/projects/040370d9de8f492f9fbe536dfdce089c => generated 0 bytes in 979 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:04.645602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8e5a-2bae-435d-bdfb-b28f3f84d0fb None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:04.646190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8e5a-2bae-435d-bdfb-b28f3f84d0fb None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:04.646693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8e5a-2bae-435d-bdfb-b28f3f84d0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:04.701617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-889d8e5a-2bae-435d-bdfb-b28f3f84d0fb None None] MFA Rules not processed for user `8fc916f852f4433eac4a3a2a12384834`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:04.705979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-889d8e5a-2bae-435d-bdfb-b28f3f84d0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:04.872138 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d57a2c-fa34-481c-88a6-b7f15e897c0d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:04.879129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 891/1740] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:04.880442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d8e5a-2bae-435d-bdfb-b28f3f84d0fb None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:04.887680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-889d8e5a-2bae-435d-bdfb-b28f3f84d0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:04.902298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1f463-51c5-40c7-8ef4-7ca3628e3974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:04.903027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f463-51c5-40c7-8ef4-7ca3628e3974 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:04.903322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f463-51c5-40c7-8ef4-7ca3628e3974 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:04.903604 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f463-51c5-40c7-8ef4-7ca3628e3974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:04.907821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-48d1f463-51c5-40c7-8ef4-7ca3628e3974 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:04.996222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1f463-51c5-40c7-8ef4-7ca3628e3974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:05.008701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1f463-51c5-40c7-8ef4-7ca3628e3974 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:05.090148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 850/1741] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:05.247509 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d8e5a-2bae-435d-bdfb-b28f3f84d0fb None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:05.277215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:05.278913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:05.279414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:05.279882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] PATH_INFO: `/v3/users/856531597db8467b92d476645dc1f444` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:05.283467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856531597db8467b92d476645dc1f444)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:05.286875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:05.471961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856531597db8467b92d476645dc1f444'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:05.473938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856531597db8467b92d476645dc1f444'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:05.475715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856531597db8467b92d476645dc1f444'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:05.533304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856531597db8467b92d476645dc1f444'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:05.553709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2ef99945-c946-4bcb-a1b7-ff1d583df418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856531597db8467b92d476645dc1f444'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:05.584078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 892/1742] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:04 2022] DELETE /identity/v3/users/856531597db8467b92d476645dc1f444 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:06.233587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1f463-51c5-40c7-8ef4-7ca3628e3974 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:06.236598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-48d1f463-51c5-40c7-8ef4-7ca3628e3974 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:06.273341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1f463-51c5-40c7-8ef4-7ca3628e3974 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:06.358297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:06.377118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:06.379454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:06.379904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:06.380415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] PATH_INFO: `/v3/projects/848a6c23cf0745f685b6629b9fa20ae4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:06.383538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=848a6c23cf0745f685b6629b9fa20ae4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:06.387538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:06.537333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848a6c23cf0745f685b6629b9fa20ae4', 'request_id': 'req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.577964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848a6c23cf0745f685b6629b9fa20ae4', 'request_id': 'req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.614835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848a6c23cf0745f685b6629b9fa20ae4', 'request_id': 'req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.701419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] The token cache is being invalidate because project 848a6c23cf0745f685b6629b9fa20ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:06.701782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.704224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1604e481-6fda-4c59-b039-0bf8d5a1a8bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.721585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 851/1743] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:06 2022] DELETE /identity/v3/projects/848a6c23cf0745f685b6629b9fa20ae4 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:06.727738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d666f-40d4-41f5-9723-db603f7c2b5b None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:06.729040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d666f-40d4-41f5-9723-db603f7c2b5b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:06.729530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d666f-40d4-41f5-9723-db603f7c2b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:06.788917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-281d666f-40d4-41f5-9723-db603f7c2b5b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:06.791185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-281d666f-40d4-41f5-9723-db603f7c2b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:06.829428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:06.968013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 893/1744] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:06.976037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33e998-ebd1-4d29-85a7-db82efd7ccac None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:06.976641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33e998-ebd1-4d29-85a7-db82efd7ccac None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:06.977033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33e998-ebd1-4d29-85a7-db82efd7ccac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.027890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8a33e998-ebd1-4d29-85a7-db82efd7ccac None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:07.029326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8a33e998-ebd1-4d29-85a7-db82efd7ccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:07.067299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 852/1745] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:07.071843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d666f-40d4-41f5-9723-db603f7c2b5b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.109296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d666f-40d4-41f5-9723-db603f7c2b5b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.116722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f896821-8bca-4235-b9a3-018961e831f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.120467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f896821-8bca-4235-b9a3-018961e831f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.121070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f896821-8bca-4235-b9a3-018961e831f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.121644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f896821-8bca-4235-b9a3-018961e831f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.122675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f896821-8bca-4235-b9a3-018961e831f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:07.123901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f896821-8bca-4235-b9a3-018961e831f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.127443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f896821-8bca-4235-b9a3-018961e831f9 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.179627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 894/1746] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:07.181759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33e998-ebd1-4d29-85a7-db82efd7ccac None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.199960 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33e998-ebd1-4d29-85a7-db82efd7ccac None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.220438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6978348-7257-422c-bce8-0663fe4bd097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.223320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978348-7257-422c-bce8-0663fe4bd097 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.223805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978348-7257-422c-bce8-0663fe4bd097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.224128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978348-7257-422c-bce8-0663fe4bd097 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.224984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6978348-7257-422c-bce8-0663fe4bd097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.228214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6978348-7257-422c-bce8-0663fe4bd097 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.341172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 853/1747] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:07 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:07.360375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f896821-8bca-4235-b9a3-018961e831f9 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.386911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f896821-8bca-4235-b9a3-018961e831f9 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.625597 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36254bfa-4a19-4a2a-8b0d-94faa3e857bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.628760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36254bfa-4a19-4a2a-8b0d-94faa3e857bb admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.629292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36254bfa-4a19-4a2a-8b0d-94faa3e857bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.629926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36254bfa-4a19-4a2a-8b0d-94faa3e857bb admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.631320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36254bfa-4a19-4a2a-8b0d-94faa3e857bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.642614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36254bfa-4a19-4a2a-8b0d-94faa3e857bb admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.705437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 895/1748] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:07 2022] POST /identity/v3/users => generated 293 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:07.712127 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6978348-7257-422c-bce8-0663fe4bd097 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.729579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6978348-7257-422c-bce8-0663fe4bd097 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.749904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d2221-6a3f-4e54-934e-9b940104b8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.753282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d2221-6a3f-4e54-934e-9b940104b8de admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.755378 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d2221-6a3f-4e54-934e-9b940104b8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.756432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d2221-6a3f-4e54-934e-9b940104b8de admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.779489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d2221-6a3f-4e54-934e-9b940104b8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.801797 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d2221-6a3f-4e54-934e-9b940104b8de admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.823632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36254bfa-4a19-4a2a-8b0d-94faa3e857bb admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.833729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 854/1749] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:07.838723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36254bfa-4a19-4a2a-8b0d-94faa3e857bb admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.854490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b222d-60ca-48ce-b0bb-479045149676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.855291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b222d-60ca-48ce-b0bb-479045149676 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.855614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b222d-60ca-48ce-b0bb-479045149676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.855907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b222d-60ca-48ce-b0bb-479045149676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.856673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b222d-60ca-48ce-b0bb-479045149676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.858477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b222d-60ca-48ce-b0bb-479045149676 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.901071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d2221-6a3f-4e54-934e-9b940104b8de admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.909246 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 896/1750] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:07.916833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d2221-6a3f-4e54-934e-9b940104b8de admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.944200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b78534-41fd-4557-9f06-5727e089ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.948135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78534-41fd-4557-9f06-5727e089ba1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.950076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78534-41fd-4557-9f06-5727e089ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.952473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78534-41fd-4557-9f06-5727e089ba1e admin admin] PATH_INFO: `/v3/projects/c791a19711564f5aa7537716f2b1e3f3/users/dc17fa6b1c2843fbb89bdb3869a2fec8/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.041546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b78534-41fd-4557-9f06-5727e089ba1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c791a19711564f5aa7537716f2b1e3f3, user_id=dc17fa6b1c2843fbb89bdb3869a2fec8, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.057983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b78534-41fd-4557-9f06-5727e089ba1e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.124244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 855/1751] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:07 2022] PUT /identity/v3/projects/c791a19711564f5aa7537716f2b1e3f3/users/dc17fa6b1c2843fbb89bdb3869a2fec8/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:08.135261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f174e9-c578-40b8-8869-1ead761b582e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.135728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f174e9-c578-40b8-8869-1ead761b582e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.136230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f174e9-c578-40b8-8869-1ead761b582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.195382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a8f174e9-c578-40b8-8869-1ead761b582e None None] MFA Rules not processed for user `dc17fa6b1c2843fbb89bdb3869a2fec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:08.199960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a8f174e9-c578-40b8-8869-1ead761b582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:08.348394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b78534-41fd-4557-9f06-5727e089ba1e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.351993 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f5b78534-41fd-4557-9f06-5727e089ba1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:08.424401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 897/1752] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:08.428999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f174e9-c578-40b8-8869-1ead761b582e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.455713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:08.541534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f174e9-c578-40b8-8869-1ead761b582e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.551284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fefc5f-3de5-4aa5-bfa5-5ee7647aca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.552151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefc5f-3de5-4aa5-bfa5-5ee7647aca32 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.552552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefc5f-3de5-4aa5-bfa5-5ee7647aca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.552904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefc5f-3de5-4aa5-bfa5-5ee7647aca32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.554170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fefc5f-3de5-4aa5-bfa5-5ee7647aca32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.556619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fefc5f-3de5-4aa5-bfa5-5ee7647aca32 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.614229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 898/1753] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:08 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:08.616282 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fefc5f-3de5-4aa5-bfa5-5ee7647aca32 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.799220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b78534-41fd-4557-9f06-5727e089ba1e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.810898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fefc5f-3de5-4aa5-bfa5-5ee7647aca32 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.829919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.829919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.833039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.834287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] PATH_INFO: `/v3/projects/f61beab5e733459e916caeb819cce60d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.840068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61beab5e733459e916caeb819cce60d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.846883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6413555-b189-4972-95df-c81820d868eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.849021 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413555-b189-4972-95df-c81820d868eb admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.849910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413555-b189-4972-95df-c81820d868eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.851025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413555-b189-4972-95df-c81820d868eb admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.852677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.853806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6413555-b189-4972-95df-c81820d868eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.859142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6413555-b189-4972-95df-c81820d868eb admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.904839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:08.951296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 899/1754] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:08 2022] POST /identity/v3/users => generated 299 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:08.955706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6413555-b189-4972-95df-c81820d868eb admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.987938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6413555-b189-4972-95df-c81820d868eb admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:09.008788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61beab5e733459e916caeb819cce60d', 'request_id': 'req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.031853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61beab5e733459e916caeb819cce60d', 'request_id': 'req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.057512 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61beab5e733459e916caeb819cce60d', 'request_id': 'req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.099215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] The token cache is being invalidate because project f61beab5e733459e916caeb819cce60d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:09.099914 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.102136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4edd3d22-3e3f-49b2-bad2-7133d9597fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.107796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 856/1755] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:08 2022] DELETE /identity/v3/projects/f61beab5e733459e916caeb819cce60d => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:09.148792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99d23-f962-4b38-ae56-aad53eaebc2f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.152240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99d23-f962-4b38-ae56-aad53eaebc2f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.152973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99d23-f962-4b38-ae56-aad53eaebc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.235425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6fc99d23-f962-4b38-ae56-aad53eaebc2f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:09.237009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6fc99d23-f962-4b38-ae56-aad53eaebc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:09.305622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749afb0-4829-40ee-887d-8ba64c66e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:09.306392 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749afb0-4829-40ee-887d-8ba64c66e9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.306714 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749afb0-4829-40ee-887d-8ba64c66e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.306999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749afb0-4829-40ee-887d-8ba64c66e9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.307798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749afb0-4829-40ee-887d-8ba64c66e9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:09.316046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749afb0-4829-40ee-887d-8ba64c66e9b5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:09.358379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 900/1756] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:09.360812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749afb0-4829-40ee-887d-8ba64c66e9b5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:09.368818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0749afb0-4829-40ee-887d-8ba64c66e9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:09.401195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749afb0-4829-40ee-887d-8ba64c66e9b5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:09.425439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd049681-9715-41e1-b85f-3ea2c4eb109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:09.426380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd049681-9715-41e1-b85f-3ea2c4eb109f admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.426725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd049681-9715-41e1-b85f-3ea2c4eb109f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.427010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd049681-9715-41e1-b85f-3ea2c4eb109f admin admin] PATH_INFO: `/v3/projects/56ba0f83fdd44cdeb06262361daf9f2e/users/fa159f05d9464020b407f08cf413ebbe/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.452337 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 857/1757] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:09.463600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc99d23-f962-4b38-ae56-aad53eaebc2f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:09.466608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6fc99d23-f962-4b38-ae56-aad53eaebc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:09.489420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd049681-9715-41e1-b85f-3ea2c4eb109f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ba0f83fdd44cdeb06262361daf9f2e, user_id=fa159f05d9464020b407f08cf413ebbe, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:09.495596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc99d23-f962-4b38-ae56-aad53eaebc2f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:09.500583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd049681-9715-41e1-b85f-3ea2c4eb109f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:09.515058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:09.516498 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.517756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.518192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] PATH_INFO: `/v3/projects/021acf422cf84eccb8c09065a413df40` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.520714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021acf422cf84eccb8c09065a413df40)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:09.523172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:09.527941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:09.534239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 901/1758] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:09 2022] PUT /identity/v3/projects/56ba0f83fdd44cdeb06262361daf9f2e/users/fa159f05d9464020b407f08cf413ebbe/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:09.535668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286dc5-303b-4a6c-a4b5-b0e82995bf11 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.535959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286dc5-303b-4a6c-a4b5-b0e82995bf11 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.536241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286dc5-303b-4a6c-a4b5-b0e82995bf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.578977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-ad286dc5-303b-4a6c-a4b5-b0e82995bf11 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:09.586355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ad286dc5-303b-4a6c-a4b5-b0e82995bf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:09.687960 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021acf422cf84eccb8c09065a413df40', 'request_id': 'req-b9ccacca-7928-433d-94cb-e226fd6e0056'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.705989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021acf422cf84eccb8c09065a413df40', 'request_id': 'req-b9ccacca-7928-433d-94cb-e226fd6e0056'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.725384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021acf422cf84eccb8c09065a413df40', 'request_id': 'req-b9ccacca-7928-433d-94cb-e226fd6e0056'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.748859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] The token cache is being invalidate because project 021acf422cf84eccb8c09065a413df40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:09.751105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.751536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.763931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 858/1759] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:09 2022] DELETE /identity/v3/projects/021acf422cf84eccb8c09065a413df40 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:09.763931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:09.763931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:09.799475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 902/1760] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:09.803977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc79724-3b49-4313-96dc-9b9c5b2fd55e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.804277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc79724-3b49-4313-96dc-9b9c5b2fd55e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.804565 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc79724-3b49-4313-96dc-9b9c5b2fd55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.855506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-bcc79724-3b49-4313-96dc-9b9c5b2fd55e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:09.856857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-bcc79724-3b49-4313-96dc-9b9c5b2fd55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:09.860555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:09.965805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccacca-7928-433d-94cb-e226fd6e0056 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:09.976986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b6732-cb19-4f4a-b19a-17f94a8df628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:09.978203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b6732-cb19-4f4a-b19a-17f94a8df628 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.978492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b6732-cb19-4f4a-b19a-17f94a8df628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.980095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b6732-cb19-4f4a-b19a-17f94a8df628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.981924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b6732-cb19-4f4a-b19a-17f94a8df628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:09.985734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b6732-cb19-4f4a-b19a-17f94a8df628 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.020033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 859/1761] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:10.027299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 903/1762] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:10.029909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc79724-3b49-4313-96dc-9b9c5b2fd55e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.031417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b6732-cb19-4f4a-b19a-17f94a8df628 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.061677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc79724-3b49-4313-96dc-9b9c5b2fd55e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.062185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b6732-cb19-4f4a-b19a-17f94a8df628 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.077857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4bf20-7d61-4a7b-9de4-9eb1b9b8ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.078595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4bf20-7d61-4a7b-9de4-9eb1b9b8ce3e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.079693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac01399-f300-474c-b9ef-37ab66c59ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.080624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01399-f300-474c-b9ef-37ab66c59ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.080977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4bf20-7d61-4a7b-9de4-9eb1b9b8ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.081265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4bf20-7d61-4a7b-9de4-9eb1b9b8ce3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.082035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4bf20-7d61-4a7b-9de4-9eb1b9b8ce3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:10.082348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4bf20-7d61-4a7b-9de4-9eb1b9b8ce3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.084076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4bf20-7d61-4a7b-9de4-9eb1b9b8ce3e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.085656 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01399-f300-474c-b9ef-37ab66c59ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.085975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01399-f300-474c-b9ef-37ab66c59ff5 admin admin] PATH_INFO: `/v3/projects/56ba0f83fdd44cdeb06262361daf9f2e/users/fa159f05d9464020b407f08cf413ebbe/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.089872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac01399-f300-474c-b9ef-37ab66c59ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ba0f83fdd44cdeb06262361daf9f2e, user_id=fa159f05d9464020b407f08cf413ebbe, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.092700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac01399-f300-474c-b9ef-37ab66c59ff5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.126328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 860/1763] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:10.126639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 904/1764] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:10 2022] PUT /identity/v3/projects/56ba0f83fdd44cdeb06262361daf9f2e/users/fa159f05d9464020b407f08cf413ebbe/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:10.127217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a68646-56c8-47c1-a729-744611ab91f5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.127217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a68646-56c8-47c1-a729-744611ab91f5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.127217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a68646-56c8-47c1-a729-744611ab91f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.139765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac01399-f300-474c-b9ef-37ab66c59ff5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.178686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-54a68646-56c8-47c1-a729-744611ab91f5 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:10.184305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-54a68646-56c8-47c1-a729-744611ab91f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:10.290394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac01399-f300-474c-b9ef-37ab66c59ff5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.313781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9437-7a37-495a-a16b-b1d34ea082af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.316574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9437-7a37-495a-a16b-b1d34ea082af admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.316574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9437-7a37-495a-a16b-b1d34ea082af admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.316574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9437-7a37-495a-a16b-b1d34ea082af admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.318851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 861/1765] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:10.320972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48366086-f00f-4553-9dfd-1ab24ef402e5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.322528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48366086-f00f-4553-9dfd-1ab24ef402e5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.323260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48366086-f00f-4553-9dfd-1ab24ef402e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.324727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c9437-7a37-495a-a16b-b1d34ea082af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.330899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c9437-7a37-495a-a16b-b1d34ea082af admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.386699 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 905/1766] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/projects => generated 379 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:10.387844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9437-7a37-495a-a16b-b1d34ea082af admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.404200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-48366086-f00f-4553-9dfd-1ab24ef402e5 None None] MFA Rules not processed for user `fa159f05d9464020b407f08cf413ebbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:10.405456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-48366086-f00f-4553-9dfd-1ab24ef402e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:10.420210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:10.514763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 862/1767] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:10.516323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48366086-f00f-4553-9dfd-1ab24ef402e5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.524675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9437-7a37-495a-a16b-b1d34ea082af admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.528837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48366086-f00f-4553-9dfd-1ab24ef402e5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.535059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109092e1-798e-46e5-94bf-097947feb2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.535923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109092e1-798e-46e5-94bf-097947feb2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.536533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109092e1-798e-46e5-94bf-097947feb2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.536651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109092e1-798e-46e5-94bf-097947feb2c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.537468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109092e1-798e-46e5-94bf-097947feb2c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.538861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729735fd-4617-4162-b833-4079e0678c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.539557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729735fd-4617-4162-b833-4079e0678c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.539843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729735fd-4617-4162-b833-4079e0678c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.540188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729735fd-4617-4162-b833-4079e0678c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.540967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729735fd-4617-4162-b833-4079e0678c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:10.541262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109092e1-798e-46e5-94bf-097947feb2c3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.541379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729735fd-4617-4162-b833-4079e0678c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.543100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729735fd-4617-4162-b833-4079e0678c64 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.563696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 906/1768] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:10.564853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729735fd-4617-4162-b833-4079e0678c64 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.566990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-729735fd-4617-4162-b833-4079e0678c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:10.577047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 863/1769] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/users => generated 290 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:10.579242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109092e1-798e-46e5-94bf-097947feb2c3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.605677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109092e1-798e-46e5-94bf-097947feb2c3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.612029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740e70-222a-430b-b8b7-ddd028843411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.613629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740e70-222a-430b-b8b7-ddd028843411 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.614066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740e70-222a-430b-b8b7-ddd028843411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.614662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740e70-222a-430b-b8b7-ddd028843411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.615761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd740e70-222a-430b-b8b7-ddd028843411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.619571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd740e70-222a-430b-b8b7-ddd028843411 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.648790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:10.659352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729735fd-4617-4162-b833-4079e0678c64 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.665437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 864/1770] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:10.665674 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09996550-4d55-481b-900a-ea82a985abb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.666380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09996550-4d55-481b-900a-ea82a985abb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.666707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09996550-4d55-481b-900a-ea82a985abb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.667081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09996550-4d55-481b-900a-ea82a985abb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.667994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740e70-222a-430b-b8b7-ddd028843411 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.680985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09996550-4d55-481b-900a-ea82a985abb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.683594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09996550-4d55-481b-900a-ea82a985abb0 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.697594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 907/1771] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:10.699171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09996550-4d55-481b-900a-ea82a985abb0 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.713726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09996550-4d55-481b-900a-ea82a985abb0 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.840983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bbb5d-79f1-4239-a7e2-7edcd9f46814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.841789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bbb5d-79f1-4239-a7e2-7edcd9f46814 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.842136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bbb5d-79f1-4239-a7e2-7edcd9f46814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.855416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bbb5d-79f1-4239-a7e2-7edcd9f46814 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.856955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bbb5d-79f1-4239-a7e2-7edcd9f46814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.861404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bbb5d-79f1-4239-a7e2-7edcd9f46814 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.893585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740e70-222a-430b-b8b7-ddd028843411 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.902299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbbedc-33cd-4c88-94cb-e46f3436c84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.903837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 908/1772] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:10.906911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbbedc-33cd-4c88-94cb-e46f3436c84c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.907277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbbedc-33cd-4c88-94cb-e46f3436c84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.907552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbbedc-33cd-4c88-94cb-e46f3436c84c admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.908368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bbb5d-79f1-4239-a7e2-7edcd9f46814 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.908489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbbedc-33cd-4c88-94cb-e46f3436c84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.910083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbbedc-33cd-4c88-94cb-e46f3436c84c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.928847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bbb5d-79f1-4239-a7e2-7edcd9f46814 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.939013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 865/1773] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:10.942166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbbedc-33cd-4c88-94cb-e46f3436c84c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.944069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0140b-37a5-466a-8f15-03a7aaeb6cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.944705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0140b-37a5-466a-8f15-03a7aaeb6cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.945095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0140b-37a5-466a-8f15-03a7aaeb6cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.945475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0140b-37a5-466a-8f15-03a7aaeb6cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.946378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0140b-37a5-466a-8f15-03a7aaeb6cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.948378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0140b-37a5-466a-8f15-03a7aaeb6cd9 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.970758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 909/1774] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:10.975437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0140b-37a5-466a-8f15-03a7aaeb6cd9 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.993710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0140b-37a5-466a-8f15-03a7aaeb6cd9 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.004655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbbedc-33cd-4c88-94cb-e46f3436c84c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.010219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91550de3-2140-4f44-85c6-213c5b475225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.010219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91550de3-2140-4f44-85c6-213c5b475225 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.010219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91550de3-2140-4f44-85c6-213c5b475225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.010219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91550de3-2140-4f44-85c6-213c5b475225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.010812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91550de3-2140-4f44-85c6-213c5b475225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.012926 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db4291-1ed3-4147-b814-93b764221c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.014021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db4291-1ed3-4147-b814-93b764221c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.014379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db4291-1ed3-4147-b814-93b764221c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.014975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db4291-1ed3-4147-b814-93b764221c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.015704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db4291-1ed3-4147-b814-93b764221c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.017430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db4291-1ed3-4147-b814-93b764221c58 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.022725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91550de3-2140-4f44-85c6-213c5b475225 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.036964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 866/1775] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:11.040427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db4291-1ed3-4147-b814-93b764221c58 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.051287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db4291-1ed3-4147-b814-93b764221c58 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.056150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d00a3-8427-4d0f-9da6-80b1f22e0f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.057323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d00a3-8427-4d0f-9da6-80b1f22e0f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.057605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d00a3-8427-4d0f-9da6-80b1f22e0f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.058089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d00a3-8427-4d0f-9da6-80b1f22e0f09 admin admin] PATH_INFO: `/v3/projects/9b1f7835894c46f785e2e02aba5339be/users/697aa5247c62471d9ba26aca4690f7fd/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.059865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 910/1776] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:11.064272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91550de3-2140-4f44-85c6-213c5b475225 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.082054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91550de3-2140-4f44-85c6-213c5b475225 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.094957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fcb0e-950f-40b5-8078-e3a7040a11af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.096564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcb0e-950f-40b5-8078-e3a7040a11af admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.096922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcb0e-950f-40b5-8078-e3a7040a11af admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.097434 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcb0e-950f-40b5-8078-e3a7040a11af admin admin] PATH_INFO: `/v3/projects/2d97363903ae472693d77b2dc14ee3a2/users/f7049cf583174582aa07ccd1395e8eb5/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.100037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d00a3-8427-4d0f-9da6-80b1f22e0f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1f7835894c46f785e2e02aba5339be, user_id=697aa5247c62471d9ba26aca4690f7fd, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.120881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d00a3-8427-4d0f-9da6-80b1f22e0f09 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.156891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fcb0e-950f-40b5-8078-e3a7040a11af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d97363903ae472693d77b2dc14ee3a2, user_id=f7049cf583174582aa07ccd1395e8eb5, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.159806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fcb0e-950f-40b5-8078-e3a7040a11af admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.166010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 867/1777] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:11 2022] PUT /identity/v3/projects/9b1f7835894c46f785e2e02aba5339be/users/697aa5247c62471d9ba26aca4690f7fd/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:11.167911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1b882-ba5e-47ac-860d-cdce7df38ffd None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.168200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1b882-ba5e-47ac-860d-cdce7df38ffd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.168603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1b882-ba5e-47ac-860d-cdce7df38ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.191760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:11.217531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 911/1778] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:11 2022] PUT /identity/v3/projects/2d97363903ae472693d77b2dc14ee3a2/users/f7049cf583174582aa07ccd1395e8eb5/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:11.229881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45ed1e-350f-45a7-a965-fa18352db6f0 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.230225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45ed1e-350f-45a7-a965-fa18352db6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.230607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45ed1e-350f-45a7-a965-fa18352db6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.293666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-6f45ed1e-350f-45a7-a965-fa18352db6f0 None None] MFA Rules not processed for user `f7049cf583174582aa07ccd1395e8eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:11.299862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-6f45ed1e-350f-45a7-a965-fa18352db6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:11.301392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6ba1b882-ba5e-47ac-860d-cdce7df38ffd None None] MFA Rules not processed for user `697aa5247c62471d9ba26aca4690f7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:11.306026 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6ba1b882-ba5e-47ac-860d-cdce7df38ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:11.444397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 868/1779] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:11.446692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1b882-ba5e-47ac-860d-cdce7df38ffd None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.487381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 912/1780] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:11.491859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45ed1e-350f-45a7-a965-fa18352db6f0 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.520778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:11.568755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1b882-ba5e-47ac-860d-cdce7df38ffd None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.577256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f6647-c18b-470d-8117-2ed578d37e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.577949 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f6647-c18b-470d-8117-2ed578d37e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.578228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f6647-c18b-470d-8117-2ed578d37e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.578518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f6647-c18b-470d-8117-2ed578d37e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.579376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f6647-c18b-470d-8117-2ed578d37e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.583778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f6647-c18b-470d-8117-2ed578d37e15 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.633526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 869/1781] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:11.635018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f6647-c18b-470d-8117-2ed578d37e15 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.646119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45ed1e-350f-45a7-a965-fa18352db6f0 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.740705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f6647-c18b-470d-8117-2ed578d37e15 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.750369 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767983-4ff2-45f8-9133-77db9ecb8293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.751727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767983-4ff2-45f8-9133-77db9ecb8293 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.752057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767983-4ff2-45f8-9133-77db9ecb8293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.753552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767983-4ff2-45f8-9133-77db9ecb8293 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.754488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33767983-4ff2-45f8-9133-77db9ecb8293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.763193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33767983-4ff2-45f8-9133-77db9ecb8293 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.802959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 870/1782] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:11.807092 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767983-4ff2-45f8-9133-77db9ecb8293 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.812660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd486d27-ccf0-4eee-93eb-beee738cae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.813053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd486d27-ccf0-4eee-93eb-beee738cae60 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.813375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd486d27-ccf0-4eee-93eb-beee738cae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.814970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd486d27-ccf0-4eee-93eb-beee738cae60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.816205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd486d27-ccf0-4eee-93eb-beee738cae60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.819005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd486d27-ccf0-4eee-93eb-beee738cae60 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.834233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767983-4ff2-45f8-9133-77db9ecb8293 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.841122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915e12-d2a6-4a60-b7ab-4e1220e84b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.842235 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915e12-d2a6-4a60-b7ab-4e1220e84b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.842789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915e12-d2a6-4a60-b7ab-4e1220e84b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.843316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915e12-d2a6-4a60-b7ab-4e1220e84b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.844424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73915e12-d2a6-4a60-b7ab-4e1220e84b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.847370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73915e12-d2a6-4a60-b7ab-4e1220e84b6c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.864565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 871/1783] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:11.869464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915e12-d2a6-4a60-b7ab-4e1220e84b6c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.884473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915e12-d2a6-4a60-b7ab-4e1220e84b6c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.890573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed10e8c-2e38-4c28-9c60-b1b7566a0d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.892326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed10e8c-2e38-4c28-9c60-b1b7566a0d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.892762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed10e8c-2e38-4c28-9c60-b1b7566a0d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.893926 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed10e8c-2e38-4c28-9c60-b1b7566a0d61 admin admin] PATH_INFO: `/v3/projects/d80acdd856ef425988d84a03fc3fec61/users/9a3bb3e9d5b148a5b6302717bbcc1823/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.902647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 913/1784] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/projects => generated 365 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:11.904349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd486d27-ccf0-4eee-93eb-beee738cae60 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.932303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed10e8c-2e38-4c28-9c60-b1b7566a0d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80acdd856ef425988d84a03fc3fec61, user_id=9a3bb3e9d5b148a5b6302717bbcc1823, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.937240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed10e8c-2e38-4c28-9c60-b1b7566a0d61 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.951404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:11.960863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 872/1785] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:11 2022] PUT /identity/v3/projects/d80acdd856ef425988d84a03fc3fec61/users/9a3bb3e9d5b148a5b6302717bbcc1823/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:11.967514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed10e8c-2e38-4c28-9c60-b1b7566a0d61 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.010369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd486d27-ccf0-4eee-93eb-beee738cae60 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.115542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed10e8c-2e38-4c28-9c60-b1b7566a0d61 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.122062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.123100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ca90-104f-48dd-b06e-2cbd7fd6e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.123282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.123665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.124037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] PATH_INFO: `/v3/users/dc17fa6b1c2843fbb89bdb3869a2fec8` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.124212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ca90-104f-48dd-b06e-2cbd7fd6e7bf admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.124504 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ca90-104f-48dd-b06e-2cbd7fd6e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.125595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc17fa6b1c2843fbb89bdb3869a2fec8)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.125957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ca90-104f-48dd-b06e-2cbd7fd6e7bf admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.126831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2ca90-104f-48dd-b06e-2cbd7fd6e7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.127956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.129397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2ca90-104f-48dd-b06e-2cbd7fd6e7bf admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.198894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:12.225354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 914/1786] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/users => generated 289 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:12.226845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ca90-104f-48dd-b06e-2cbd7fd6e7bf admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.260589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ca90-104f-48dd-b06e-2cbd7fd6e7bf admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.265630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc17fa6b1c2843fbb89bdb3869a2fec8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.270561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfec64-6798-491b-8fb7-77cadfbe9748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.282206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc17fa6b1c2843fbb89bdb3869a2fec8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.283123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc17fa6b1c2843fbb89bdb3869a2fec8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.283689 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfec64-6798-491b-8fb7-77cadfbe9748 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.284301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfec64-6798-491b-8fb7-77cadfbe9748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.284594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfec64-6798-491b-8fb7-77cadfbe9748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.288172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfec64-6798-491b-8fb7-77cadfbe9748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.290295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfec64-6798-491b-8fb7-77cadfbe9748 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.308597 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 915/1787] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:12.308597 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfec64-6798-491b-8fb7-77cadfbe9748 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.311462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cabfec64-6798-491b-8fb7-77cadfbe9748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:12.318601 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc17fa6b1c2843fbb89bdb3869a2fec8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.333917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfec64-6798-491b-8fb7-77cadfbe9748 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.344830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17bea6-8397-4359-9d33-1d377dd89186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.345768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17bea6-8397-4359-9d33-1d377dd89186 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.346050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17bea6-8397-4359-9d33-1d377dd89186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.346434 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17bea6-8397-4359-9d33-1d377dd89186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.349405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17bea6-8397-4359-9d33-1d377dd89186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.349745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17bea6-8397-4359-9d33-1d377dd89186 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.360415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc17fa6b1c2843fbb89bdb3869a2fec8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.376922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 916/1788] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:12.379798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17bea6-8397-4359-9d33-1d377dd89186 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.380030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 873/1789] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:11 2022] DELETE /identity/v3/users/dc17fa6b1c2843fbb89bdb3869a2fec8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:12.380868 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.387344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4e17bea6-8397-4359-9d33-1d377dd89186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:12.416605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17bea6-8397-4359-9d33-1d377dd89186 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.560389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f6e83-3dc0-4818-8b10-3945234cb72b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.571652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0125-fcea-40dc-a5d4-5972e7823ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.573745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0125-fcea-40dc-a5d4-5972e7823ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.574242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0125-fcea-40dc-a5d4-5972e7823ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.574750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0125-fcea-40dc-a5d4-5972e7823ba6 admin admin] PATH_INFO: `/v3/projects/006d9b7eeadf459897078e0c7644310e/users/b98cbc304ed84963b2453dbff46d7730/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.596928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc0125-fcea-40dc-a5d4-5972e7823ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006d9b7eeadf459897078e0c7644310e, user_id=b98cbc304ed84963b2453dbff46d7730, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.601216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc0125-fcea-40dc-a5d4-5972e7823ba6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.631863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 874/1790] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:12 2022] PUT /identity/v3/projects/006d9b7eeadf459897078e0c7644310e/users/b98cbc304ed84963b2453dbff46d7730/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:12.633832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7d13c-2384-483d-a780-eb1f3506a917 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.634327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7d13c-2384-483d-a780-eb1f3506a917 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.634822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7d13c-2384-483d-a780-eb1f3506a917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.672616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0db7d13c-2384-483d-a780-eb1f3506a917 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:12.673850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0db7d13c-2384-483d-a780-eb1f3506a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:12.691002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965dd16-7124-4997-be67-8e51aa0ba69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.692576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965dd16-7124-4997-be67-8e51aa0ba69b admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.692919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965dd16-7124-4997-be67-8e51aa0ba69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.693287 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965dd16-7124-4997-be67-8e51aa0ba69b admin admin] PATH_INFO: `/v3/projects/d80acdd856ef425988d84a03fc3fec61/users/9a3bb3e9d5b148a5b6302717bbcc1823/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.703814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965dd16-7124-4997-be67-8e51aa0ba69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80acdd856ef425988d84a03fc3fec61, user_id=9a3bb3e9d5b148a5b6302717bbcc1823, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.710952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965dd16-7124-4997-be67-8e51aa0ba69b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.736909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 917/1791] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:12 2022] PUT /identity/v3/projects/d80acdd856ef425988d84a03fc3fec61/users/9a3bb3e9d5b148a5b6302717bbcc1823/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:12.736909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965dd16-7124-4997-be67-8e51aa0ba69b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.772066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 875/1792] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:12.773672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff9336-3704-4381-a199-9d12c7d849d7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.774008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff9336-3704-4381-a199-9d12c7d849d7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.774286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff9336-3704-4381-a199-9d12c7d849d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.786189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:12.842984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-26ff9336-3704-4381-a199-9d12c7d849d7 None None] MFA Rules not processed for user `9a3bb3e9d5b148a5b6302717bbcc1823`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:12.844689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-26ff9336-3704-4381-a199-9d12c7d849d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:12.871519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:12.886576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965dd16-7124-4997-be67-8e51aa0ba69b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.895077 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eb52c-879f-4736-b1ab-6bda2c771918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.895786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eb52c-879f-4736-b1ab-6bda2c771918 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.896066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eb52c-879f-4736-b1ab-6bda2c771918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.896338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eb52c-879f-4736-b1ab-6bda2c771918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.897081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8eb52c-879f-4736-b1ab-6bda2c771918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.903850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8eb52c-879f-4736-b1ab-6bda2c771918 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.927894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 918/1793] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:12.928877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eb52c-879f-4736-b1ab-6bda2c771918 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.935309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ef8eb52c-879f-4736-b1ab-6bda2c771918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:12.985242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 876/1794] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:12.986235 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff9336-3704-4381-a199-9d12c7d849d7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.017251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff9336-3704-4381-a199-9d12c7d849d7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.032633 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc488f-73ed-428f-86da-6e7386588546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.033819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc488f-73ed-428f-86da-6e7386588546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.034396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc488f-73ed-428f-86da-6e7386588546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.035000 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc488f-73ed-428f-86da-6e7386588546 admin admin] PATH_INFO: `/v3/projects/006d9b7eeadf459897078e0c7644310e/users/b98cbc304ed84963b2453dbff46d7730/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.038448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc488f-73ed-428f-86da-6e7386588546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006d9b7eeadf459897078e0c7644310e, user_id=b98cbc304ed84963b2453dbff46d7730, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.042612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc488f-73ed-428f-86da-6e7386588546 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.059683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 877/1795] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:12 2022] PUT /identity/v3/projects/006d9b7eeadf459897078e0c7644310e/users/b98cbc304ed84963b2453dbff46d7730/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:13.061402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc488f-73ed-428f-86da-6e7386588546 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.063534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eb52c-879f-4736-b1ab-6bda2c771918 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.066317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-02fc488f-73ed-428f-86da-6e7386588546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:13.166729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599f232-8019-41b4-acc7-880df085dc25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.168011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599f232-8019-41b4-acc7-880df085dc25 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.168413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599f232-8019-41b4-acc7-880df085dc25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.168585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599f232-8019-41b4-acc7-880df085dc25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.188497 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc488f-73ed-428f-86da-6e7386588546 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.193477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f0d7b-2914-4d0a-b417-50ff4c7d298d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.194269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f0d7b-2914-4d0a-b417-50ff4c7d298d service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.194688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f0d7b-2914-4d0a-b417-50ff4c7d298d service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.195081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f0d7b-2914-4d0a-b417-50ff4c7d298d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.312754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f0d7b-2914-4d0a-b417-50ff4c7d298d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.316046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f0d7b-2914-4d0a-b417-50ff4c7d298d service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.322063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599f232-8019-41b4-acc7-880df085dc25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.323935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599f232-8019-41b4-acc7-880df085dc25 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.339107 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 878/1796] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:13.343221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb7c6-3da9-4c2d-b32a-9ec6c1aefd5b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.344092 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb7c6-3da9-4c2d-b32a-9ec6c1aefd5b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.346365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb7c6-3da9-4c2d-b32a-9ec6c1aefd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.373620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 919/1797] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:13.413622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bb5cb7c6-3da9-4c2d-b32a-9ec6c1aefd5b None None] MFA Rules not processed for user `b98cbc304ed84963b2453dbff46d7730`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:13.414910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bb5cb7c6-3da9-4c2d-b32a-9ec6c1aefd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:13.531472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:13.612766 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 879/1798] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:13.633408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599f232-8019-41b4-acc7-880df085dc25 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.675937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599f232-8019-41b4-acc7-880df085dc25 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.692973 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3faef-7556-400d-b2cf-988179384a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.693759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3faef-7556-400d-b2cf-988179384a48 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.694229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3faef-7556-400d-b2cf-988179384a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.694406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3faef-7556-400d-b2cf-988179384a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.721315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3faef-7556-400d-b2cf-988179384a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.724627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3faef-7556-400d-b2cf-988179384a48 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.810110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 920/1799] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:14.008754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cb7c6-3da9-4c2d-b32a-9ec6c1aefd5b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.024125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cb7c6-3da9-4c2d-b32a-9ec6c1aefd5b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.031115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a30a-0da3-464f-bdd8-20be35f72774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.031895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a30a-0da3-464f-bdd8-20be35f72774 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.032251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a30a-0da3-464f-bdd8-20be35f72774 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.032659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a30a-0da3-464f-bdd8-20be35f72774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.034765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c6c8a30a-0da3-464f-bdd8-20be35f72774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.065294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3faef-7556-400d-b2cf-988179384a48 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.065866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-00c3faef-7556-400d-b2cf-988179384a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.097803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3faef-7556-400d-b2cf-988179384a48 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.107804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.108696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.108992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.109256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] PATH_INFO: `/v3/projects/c791a19711564f5aa7537716f2b1e3f3` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.112450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c791a19711564f5aa7537716f2b1e3f3)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.114368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.127197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:14.152177 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a30a-0da3-464f-bdd8-20be35f72774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.153779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a30a-0da3-464f-bdd8-20be35f72774 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.165145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 880/1800] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:14.165992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a30a-0da3-464f-bdd8-20be35f72774 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.177334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a30a-0da3-464f-bdd8-20be35f72774 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.178843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c791a19711564f5aa7537716f2b1e3f3', 'request_id': 'req-7e5b955d-a313-402d-9bb3-1bf4019a45f5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.188215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c791a19711564f5aa7537716f2b1e3f3', 'request_id': 'req-7e5b955d-a313-402d-9bb3-1bf4019a45f5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.195855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c791a19711564f5aa7537716f2b1e3f3', 'request_id': 'req-7e5b955d-a313-402d-9bb3-1bf4019a45f5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.207410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] The token cache is being invalidate because project c791a19711564f5aa7537716f2b1e3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:14.207699 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.208356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.209982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 921/1801] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:14 2022] DELETE /identity/v3/projects/c791a19711564f5aa7537716f2b1e3f3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:14.214366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.215876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.247585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c477883-c764-4ca7-9349-d51a37baf293 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3bb3e9d5b148a5b6302717bbcc1823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd80acdd856ef425988d84a03fc3fec61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.248448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c477883-c764-4ca7-9349-d51a37baf293 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.248668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c477883-c764-4ca7-9349-d51a37baf293 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.248949 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c477883-c764-4ca7-9349-d51a37baf293 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.249696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c477883-c764-4ca7-9349-d51a37baf293 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:14.250009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c477883-c764-4ca7-9349-d51a37baf293 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.251679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c477883-c764-4ca7-9349-d51a37baf293 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.265274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 881/1802] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:14.270763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c477883-c764-4ca7-9349-d51a37baf293 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.273149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6c477883-c764-4ca7-9349-d51a37baf293 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.287810 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c477883-c764-4ca7-9349-d51a37baf293 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.294637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570a39b-69e7-473a-8cb6-e264fcd0a358 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3bb3e9d5b148a5b6302717bbcc1823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd80acdd856ef425988d84a03fc3fec61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.295478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b955d-a313-402d-9bb3-1bf4019a45f5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.295783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a39b-69e7-473a-8cb6-e264fcd0a358 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.296313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a39b-69e7-473a-8cb6-e264fcd0a358 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.296776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a39b-69e7-473a-8cb6-e264fcd0a358 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.297595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570a39b-69e7-473a-8cb6-e264fcd0a358 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.299995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570a39b-69e7-473a-8cb6-e264fcd0a358 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.316391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.317344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.317911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.318359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] PATH_INFO: `/v3/users/fa159f05d9464020b407f08cf413ebbe` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.320235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa159f05d9464020b407f08cf413ebbe)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.322541 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.333021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 882/1803] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:14 2022] POST /identity/v3/projects => generated 354 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:14.338007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570a39b-69e7-473a-8cb6-e264fcd0a358 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.406142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa159f05d9464020b407f08cf413ebbe'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.407685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa159f05d9464020b407f08cf413ebbe'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.408050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa159f05d9464020b407f08cf413ebbe'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.419766 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:14.427996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa159f05d9464020b407f08cf413ebbe'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.445031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa159f05d9464020b407f08cf413ebbe'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.461494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570a39b-69e7-473a-8cb6-e264fcd0a358 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.470119 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed2ea9-1104-4ddc-b3ea-fbc8f8b9aab1 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3bb3e9d5b148a5b6302717bbcc1823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd80acdd856ef425988d84a03fc3fec61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.470690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed2ea9-1104-4ddc-b3ea-fbc8f8b9aab1 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.471218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed2ea9-1104-4ddc-b3ea-fbc8f8b9aab1 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.471604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 922/1804] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:14 2022] DELETE /identity/v3/users/fa159f05d9464020b407f08cf413ebbe => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:14.471933 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed2ea9-1104-4ddc-b3ea-fbc8f8b9aab1 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.473679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed2ea9-1104-4ddc-b3ea-fbc8f8b9aab1 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:14.473954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed2ea9-1104-4ddc-b3ea-fbc8f8b9aab1 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.485231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed2ea9-1104-4ddc-b3ea-fbc8f8b9aab1 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.504123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 883/1805] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:14.631882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.633336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.674459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:14.756022 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4319ef-f09d-4c15-9239-58638d13b1d0 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.762892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3bb3e9d5b148a5b6302717bbcc1823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd80acdd856ef425988d84a03fc3fec61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.764267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.764981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.765619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] PATH_INFO: `/v3/projects/3b477d92dfc74a0ab85ed9fea774c196` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.767692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3b477d92dfc74a0ab85ed9fea774c196)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.769378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.841920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b477d92dfc74a0ab85ed9fea774c196', 'request_id': 'req-b497faf1-d917-4c93-9df3-d16216a762c8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.852649 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b477d92dfc74a0ab85ed9fea774c196', 'request_id': 'req-b497faf1-d917-4c93-9df3-d16216a762c8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.862535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b477d92dfc74a0ab85ed9fea774c196', 'request_id': 'req-b497faf1-d917-4c93-9df3-d16216a762c8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.878109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] The token cache is being invalidate because project 3b477d92dfc74a0ab85ed9fea774c196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:14.878412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.879150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.882586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 923/1806] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:14 2022] DELETE /identity/v3/projects/3b477d92dfc74a0ab85ed9fea774c196 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:15.175480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed2ea9-1104-4ddc-b3ea-fbc8f8b9aab1 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:15.177748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4bed2ea9-1104-4ddc-b3ea-fbc8f8b9aab1 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:15.287742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed2ea9-1104-4ddc-b3ea-fbc8f8b9aab1 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:15.375301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:15.376180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:15.376525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:15.376872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] PATH_INFO: `/v3/users/697aa5247c62471d9ba26aca4690f7fd` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:15.378432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=697aa5247c62471d9ba26aca4690f7fd)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:15.380853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:15.397168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:15.399261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:15.420622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497faf1-d917-4c93-9df3-d16216a762c8 tempest-VolumeQuotaClassesTest-32571656 tempest-VolumeQuotaClassesTest-32571656-project-admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:15.429246 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:15.430250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:15.430660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:15.431333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] PATH_INFO: `/v3/projects/56ba0f83fdd44cdeb06262361daf9f2e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:15.432719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ba0f83fdd44cdeb06262361daf9f2e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:15.435743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:15.454495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697aa5247c62471d9ba26aca4690f7fd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.480655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697aa5247c62471d9ba26aca4690f7fd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.482999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697aa5247c62471d9ba26aca4690f7fd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.521269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697aa5247c62471d9ba26aca4690f7fd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.543313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a5661811-98d3-439e-9f40-ef8b087c34a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697aa5247c62471d9ba26aca4690f7fd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.565720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 884/1807] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:15 2022] DELETE /identity/v3/users/697aa5247c62471d9ba26aca4690f7fd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:15.573358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71718db3-9a10-42f8-80ff-7b8c70142153 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:15.573874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71718db3-9a10-42f8-80ff-7b8c70142153 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:15.574667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71718db3-9a10-42f8-80ff-7b8c70142153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:15.586707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ba0f83fdd44cdeb06262361daf9f2e', 'request_id': 'req-3d958b29-2098-4d93-b733-7b8dbf8c9256'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.598449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ba0f83fdd44cdeb06262361daf9f2e', 'request_id': 'req-3d958b29-2098-4d93-b733-7b8dbf8c9256'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.605639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ba0f83fdd44cdeb06262361daf9f2e', 'request_id': 'req-3d958b29-2098-4d93-b733-7b8dbf8c9256'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.612266 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-71718db3-9a10-42f8-80ff-7b8c70142153 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:15.613879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-71718db3-9a10-42f8-80ff-7b8c70142153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:15.622688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:15.627437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] The token cache is being invalidate because project 56ba0f83fdd44cdeb06262361daf9f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:15.627601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.628287 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3d958b29-2098-4d93-b733-7b8dbf8c9256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.634807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 924/1808] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:15 2022] DELETE /identity/v3/projects/56ba0f83fdd44cdeb06262361daf9f2e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:15.637507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2934a0-47c2-422c-ae96-1d401608cd78 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:15.637863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2934a0-47c2-422c-ae96-1d401608cd78 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:15.638146 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2934a0-47c2-422c-ae96-1d401608cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:15.671784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-dd2934a0-47c2-422c-ae96-1d401608cd78 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:15.673481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-dd2934a0-47c2-422c-ae96-1d401608cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:15.727820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:15.806596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 925/1809] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:15.809083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b5c16-6caa-4cc3-b68d-2919080ff467 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:15.809372 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b5c16-6caa-4cc3-b68d-2919080ff467 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:15.809711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b5c16-6caa-4cc3-b68d-2919080ff467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:15.861105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d33b5c16-6caa-4cc3-b68d-2919080ff467 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:15.862443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d33b5c16-6caa-4cc3-b68d-2919080ff467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:15.888404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 926/1810] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:15.889682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b5c16-6caa-4cc3-b68d-2919080ff467 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:15.915858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b5c16-6caa-4cc3-b68d-2919080ff467 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:15.922140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ce63-78a9-41f9-bb85-cab45b8e428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:15.922881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ce63-78a9-41f9-bb85-cab45b8e428e admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:15.923162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ce63-78a9-41f9-bb85-cab45b8e428e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:15.923435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ce63-78a9-41f9-bb85-cab45b8e428e admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:15.925476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ce63-78a9-41f9-bb85-cab45b8e428e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:15.925476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ce63-78a9-41f9-bb85-cab45b8e428e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:15.925725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 885/1811] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:15.926116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ce63-78a9-41f9-bb85-cab45b8e428e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:15.940529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71718db3-9a10-42f8-80ff-7b8c70142153 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:15.941847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-71718db3-9a10-42f8-80ff-7b8c70142153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:15.969257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 927/1812] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:21:15.970584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ce63-78a9-41f9-bb85-cab45b8e428e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:15.982656 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ce63-78a9-41f9-bb85-cab45b8e428e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:15.990352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8ca5-a5db-4203-b507-f960672800be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:15.992082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8ca5-a5db-4203-b507-f960672800be admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:15.992082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8ca5-a5db-4203-b507-f960672800be admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:15.992082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8ca5-a5db-4203-b507-f960672800be admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.006816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb8ca5-a5db-4203-b507-f960672800be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.009027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb8ca5-a5db-4203-b507-f960672800be admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:16.057507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71718db3-9a10-42f8-80ff-7b8c70142153 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:16.061645 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14414d9d-a2fe-47de-910e-abc2c1d8d6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:16.074465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14414d9d-a2fe-47de-910e-abc2c1d8d6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.076136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14414d9d-a2fe-47de-910e-abc2c1d8d6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.077138 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14414d9d-a2fe-47de-910e-abc2c1d8d6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.093477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 928/1813] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:15 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:16.106545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14414d9d-a2fe-47de-910e-abc2c1d8d6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.107251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8ca5-a5db-4203-b507-f960672800be admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:16.108116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14414d9d-a2fe-47de-910e-abc2c1d8d6b7 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:16.130015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 886/1814] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:16.214270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8ca5-a5db-4203-b507-f960672800be admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:16.220453 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b22c0f-b343-4539-a7f3-adc5a4837f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:16.221642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b22c0f-b343-4539-a7f3-adc5a4837f02 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.222095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b22c0f-b343-4539-a7f3-adc5a4837f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.222545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b22c0f-b343-4539-a7f3-adc5a4837f02 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.223416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b22c0f-b343-4539-a7f3-adc5a4837f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.225365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b22c0f-b343-4539-a7f3-adc5a4837f02 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:16.253288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 929/1815] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:16 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:16.256415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14414d9d-a2fe-47de-910e-abc2c1d8d6b7 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:16.272538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14414d9d-a2fe-47de-910e-abc2c1d8d6b7 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:16.280673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795de01-5daf-4ad7-883e-3fbe0ef3b5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:16.283163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795de01-5daf-4ad7-883e-3fbe0ef3b5eb admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.283547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795de01-5daf-4ad7-883e-3fbe0ef3b5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.283835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795de01-5daf-4ad7-883e-3fbe0ef3b5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.284686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795de01-5daf-4ad7-883e-3fbe0ef3b5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.288099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795de01-5daf-4ad7-883e-3fbe0ef3b5eb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:16.311477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 887/1816] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:16.315900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b22c0f-b343-4539-a7f3-adc5a4837f02 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:16.327379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b22c0f-b343-4539-a7f3-adc5a4837f02 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:16.333783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772ff86-9de3-43f6-8661-da03329f4f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:16.334918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ff86-9de3-43f6-8661-da03329f4f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.335374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ff86-9de3-43f6-8661-da03329f4f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.335766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ff86-9de3-43f6-8661-da03329f4f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.336755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772ff86-9de3-43f6-8661-da03329f4f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.339769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772ff86-9de3-43f6-8661-da03329f4f84 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:16.358724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 930/1817] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:16.359426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795de01-5daf-4ad7-883e-3fbe0ef3b5eb admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:16.382868 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795de01-5daf-4ad7-883e-3fbe0ef3b5eb admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:16.402645 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688231df-f206-4da4-a9b8-736735fff4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:16.403962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688231df-f206-4da4-a9b8-736735fff4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.404457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688231df-f206-4da4-a9b8-736735fff4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.405458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688231df-f206-4da4-a9b8-736735fff4ba admin admin] PATH_INFO: `/v3/projects/70c1fc0cd21c40f0bb215d4541a520be/users/cdbe45f6588e476f86e6debad3d7c40c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.457979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688231df-f206-4da4-a9b8-736735fff4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c1fc0cd21c40f0bb215d4541a520be, user_id=cdbe45f6588e476f86e6debad3d7c40c, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.461133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688231df-f206-4da4-a9b8-736735fff4ba admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:16.523036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 888/1818] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:16 2022] PUT /identity/v3/projects/70c1fc0cd21c40f0bb215d4541a520be/users/cdbe45f6588e476f86e6debad3d7c40c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:16.535954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2f01f-cd77-46d6-8081-121fdadf81ee None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.536419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2f01f-cd77-46d6-8081-121fdadf81ee None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.537876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2f01f-cd77-46d6-8081-121fdadf81ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.619408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-dae2f01f-cd77-46d6-8081-121fdadf81ee None None] MFA Rules not processed for user `cdbe45f6588e476f86e6debad3d7c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:16.619408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-dae2f01f-cd77-46d6-8081-121fdadf81ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:16.779852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:16.791370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 931/1819] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:16.803676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688231df-f206-4da4-a9b8-736735fff4ba admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:16.824818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-688231df-f206-4da4-a9b8-736735fff4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:16.966218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688231df-f206-4da4-a9b8-736735fff4ba admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:16.971141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fddb92-1ab8-419d-8c8c-de0f32ada059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:16.972392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fddb92-1ab8-419d-8c8c-de0f32ada059 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.972811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fddb92-1ab8-419d-8c8c-de0f32ada059 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.973174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fddb92-1ab8-419d-8c8c-de0f32ada059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.993824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fddb92-1ab8-419d-8c8c-de0f32ada059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.997494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fddb92-1ab8-419d-8c8c-de0f32ada059 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.012714 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2f01f-cd77-46d6-8081-121fdadf81ee None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:17.014980 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-dae2f01f-cd77-46d6-8081-121fdadf81ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:17.032347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 889/1820] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:17.184305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2f01f-cd77-46d6-8081-121fdadf81ee None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:17.195131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:17.198054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.198419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.198886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] PATH_INFO: `/v3/projects/9b1f7835894c46f785e2e02aba5339be` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.203665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1f7835894c46f785e2e02aba5339be)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:17.205777 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.337361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1f7835894c46f785e2e02aba5339be', 'request_id': 'req-b7c4337d-7cbf-4714-9917-0ed5b54513ec'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:17.355719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1f7835894c46f785e2e02aba5339be', 'request_id': 'req-b7c4337d-7cbf-4714-9917-0ed5b54513ec'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:17.367665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1f7835894c46f785e2e02aba5339be', 'request_id': 'req-b7c4337d-7cbf-4714-9917-0ed5b54513ec'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:17.394755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] The token cache is being invalidate because project 9b1f7835894c46f785e2e02aba5339be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:17.395491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:17.397205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b7c4337d-7cbf-4714-9917-0ed5b54513ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:17.404140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 932/1821] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:17 2022] DELETE /identity/v3/projects/9b1f7835894c46f785e2e02aba5339be => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:17.405127 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fddb92-1ab8-419d-8c8c-de0f32ada059 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:17.422332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fddb92-1ab8-419d-8c8c-de0f32ada059 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:17.458329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:17.556328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:17.557427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.557860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.558382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] PATH_INFO: `/v3/users/9a3bb3e9d5b148a5b6302717bbcc1823` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.559944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3bb3e9d5b148a5b6302717bbcc1823)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:17.563956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.682030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3bb3e9d5b148a5b6302717bbcc1823'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:17.703563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3bb3e9d5b148a5b6302717bbcc1823'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:17.704202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3bb3e9d5b148a5b6302717bbcc1823'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:17.736883 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3bb3e9d5b148a5b6302717bbcc1823'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:17.749610 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0aa8b215-d86d-4e9f-a104-37856a14c464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3bb3e9d5b148a5b6302717bbcc1823'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:17.758696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 890/1822] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:17 2022] DELETE /identity/v3/users/9a3bb3e9d5b148a5b6302717bbcc1823 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:18.059910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deb90c-9e14-44f6-802d-923a279b0ce8 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.060990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deb90c-9e14-44f6-802d-923a279b0ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.061490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deb90c-9e14-44f6-802d-923a279b0ce8 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.063499 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 933/1823] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:21:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:21:18.232352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8d06-8fd7-4407-8a0e-292e6f1ad2d7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.233032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8d06-8fd7-4407-8a0e-292e6f1ad2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.233310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8d06-8fd7-4407-8a0e-292e6f1ad2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.293020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e54a8d06-8fd7-4407-8a0e-292e6f1ad2d7 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:18.295438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e54a8d06-8fd7-4407-8a0e-292e6f1ad2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:18.514849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 891/1824] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:21:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:18.712480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0846bb3-c61b-45bc-a743-43e08c45accc None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.712832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0846bb3-c61b-45bc-a743-43e08c45accc None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.713031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0846bb3-c61b-45bc-a743-43e08c45accc None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.714628 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 934/1825] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:21:18.755499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ff9cb-58df-4c8a-9241-225adb790595 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.757651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ff9cb-58df-4c8a-9241-225adb790595 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.758905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ff9cb-58df-4c8a-9241-225adb790595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.809282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-662ff9cb-58df-4c8a-9241-225adb790595 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:18.817592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-662ff9cb-58df-4c8a-9241-225adb790595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:18.842748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 892/1826] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:21:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:19.203109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0846bb3-c61b-45bc-a743-43e08c45accc None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:19.205557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b0846bb3-c61b-45bc-a743-43e08c45accc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:19.209086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ff9cb-58df-4c8a-9241-225adb790595 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:19.210618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-662ff9cb-58df-4c8a-9241-225adb790595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:19.227687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ff9cb-58df-4c8a-9241-225adb790595 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:19.234656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d0ef8-52c0-4e39-acfc-ac736b16fd1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:19.235642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d0ef8-52c0-4e39-acfc-ac736b16fd1a service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:19.236106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d0ef8-52c0-4e39-acfc-ac736b16fd1a service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:19.237400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d0ef8-52c0-4e39-acfc-ac736b16fd1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:19.252509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d0ef8-52c0-4e39-acfc-ac736b16fd1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:19.258707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d0ef8-52c0-4e39-acfc-ac736b16fd1a service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:19.288851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 893/1827] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:19.366256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0846bb3-c61b-45bc-a743-43e08c45accc None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:19.374780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:19.376099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:19.376504 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:19.377350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] PATH_INFO: `/v3/projects/d80acdd856ef425988d84a03fc3fec61` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:19.379139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80acdd856ef425988d84a03fc3fec61)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:19.381581 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:19.429785 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:19.458773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80acdd856ef425988d84a03fc3fec61', 'request_id': 'req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:19.471233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80acdd856ef425988d84a03fc3fec61', 'request_id': 'req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:19.481944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80acdd856ef425988d84a03fc3fec61', 'request_id': 'req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:19.504274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d0ef8-52c0-4e39-acfc-ac736b16fd1a service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:19.511215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2c4d0ef8-52c0-4e39-acfc-ac736b16fd1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:19.517735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] The token cache is being invalidate because project d80acdd856ef425988d84a03fc3fec61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:19.518412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:19.519367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-0cf2e79b-2ef1-4628-855d-18f6305d8cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:19.522129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 935/1828] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:19 2022] DELETE /identity/v3/projects/d80acdd856ef425988d84a03fc3fec61 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:19.528460 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72447e3d-e614-455a-9fec-a0aae092b20d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:19.528460 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72447e3d-e614-455a-9fec-a0aae092b20d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:19.528762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72447e3d-e614-455a-9fec-a0aae092b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:19.560733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d0ef8-52c0-4e39-acfc-ac736b16fd1a service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:19.581891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:19.599645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-72447e3d-e614-455a-9fec-a0aae092b20d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:19.604446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-72447e3d-e614-455a-9fec-a0aae092b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:19.747225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 936/1829] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:19.757139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b416ab-110c-4451-88bd-190418abf986 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:19.757445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b416ab-110c-4451-88bd-190418abf986 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:19.758386 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b416ab-110c-4451-88bd-190418abf986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:19.764407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b7408-e22f-4635-9315-d49bdb94245c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:19.766035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7408-e22f-4635-9315-d49bdb94245c service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:19.766764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7408-e22f-4635-9315-d49bdb94245c service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:19.767251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7408-e22f-4635-9315-d49bdb94245c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:19.770793 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-363b7408-e22f-4635-9315-d49bdb94245c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:19.787298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b7408-e22f-4635-9315-d49bdb94245c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:19.789670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b7408-e22f-4635-9315-d49bdb94245c service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:19.806386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 894/1830] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:19.820663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-81b416ab-110c-4451-88bd-190418abf986 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:19.821990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-81b416ab-110c-4451-88bd-190418abf986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:19.842550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 937/1831] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:19.847829 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b7408-e22f-4635-9315-d49bdb94245c service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:19.869727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b7408-e22f-4635-9315-d49bdb94245c service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:19.878978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902267e8-4173-48d9-a5dd-843fb428ea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:19.883067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902267e8-4173-48d9-a5dd-843fb428ea9c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:19.883233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902267e8-4173-48d9-a5dd-843fb428ea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:19.883675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902267e8-4173-48d9-a5dd-843fb428ea9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:19.897003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902267e8-4173-48d9-a5dd-843fb428ea9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:19.898715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902267e8-4173-48d9-a5dd-843fb428ea9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:19.903569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902267e8-4173-48d9-a5dd-843fb428ea9c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:19.933952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 895/1832] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:19.935641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b416ab-110c-4451-88bd-190418abf986 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:19.946209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b416ab-110c-4451-88bd-190418abf986 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:19.950570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc38cf-1a70-4b6e-99b5-25bcd3d603c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:19.951257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc38cf-1a70-4b6e-99b5-25bcd3d603c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:19.951535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc38cf-1a70-4b6e-99b5-25bcd3d603c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:19.951808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc38cf-1a70-4b6e-99b5-25bcd3d603c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:19.952574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc38cf-1a70-4b6e-99b5-25bcd3d603c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:19.954708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc38cf-1a70-4b6e-99b5-25bcd3d603c2 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.010450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 938/1833] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:19 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:20.014550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902267e8-4173-48d9-a5dd-843fb428ea9c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:20.027266 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902267e8-4173-48d9-a5dd-843fb428ea9c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:20.165251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e80e-2793-4338-bbef-0808b175b930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:20.166752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e80e-2793-4338-bbef-0808b175b930 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.166752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e80e-2793-4338-bbef-0808b175b930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.166752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e80e-2793-4338-bbef-0808b175b930 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.167220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3e80e-2793-4338-bbef-0808b175b930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:20.169621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3e80e-2793-4338-bbef-0808b175b930 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.203054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 896/1834] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:20 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:20.207444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc38cf-1a70-4b6e-99b5-25bcd3d603c2 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:20.224707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc38cf-1a70-4b6e-99b5-25bcd3d603c2 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:20.235557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345035cd-82cd-420d-bb22-d6e476188b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:20.236813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345035cd-82cd-420d-bb22-d6e476188b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.237327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345035cd-82cd-420d-bb22-d6e476188b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.237797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345035cd-82cd-420d-bb22-d6e476188b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.238873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345035cd-82cd-420d-bb22-d6e476188b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:20.240908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345035cd-82cd-420d-bb22-d6e476188b1d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.258016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 939/1835] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:20.262053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e80e-2793-4338-bbef-0808b175b930 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:20.277123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e80e-2793-4338-bbef-0808b175b930 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:20.296058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f45d3-9596-4845-abc2-4a9ba9510e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:20.296372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f45d3-9596-4845-abc2-4a9ba9510e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.296580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f45d3-9596-4845-abc2-4a9ba9510e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.296925 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f45d3-9596-4845-abc2-4a9ba9510e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.297877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f45d3-9596-4845-abc2-4a9ba9510e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:20.299592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f45d3-9596-4845-abc2-4a9ba9510e37 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.305820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345035cd-82cd-420d-bb22-d6e476188b1d admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:20.307728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-345035cd-82cd-420d-bb22-d6e476188b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:20.329308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345035cd-82cd-420d-bb22-d6e476188b1d admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:20.329963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 897/1836] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:20.333049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f45d3-9596-4845-abc2-4a9ba9510e37 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:20.344675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:20.345901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.346387 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.346894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] PATH_INFO: `/v3/users/f7049cf583174582aa07ccd1395e8eb5` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.348564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7049cf583174582aa07ccd1395e8eb5)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:20.350684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.351717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f45d3-9596-4845-abc2-4a9ba9510e37 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:20.369816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7663e6-a12a-4b71-ba0a-7b7370c76726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:20.370995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7663e6-a12a-4b71-ba0a-7b7370c76726 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.371286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7663e6-a12a-4b71-ba0a-7b7370c76726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.372624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7663e6-a12a-4b71-ba0a-7b7370c76726 admin admin] PATH_INFO: `/v3/projects/a9869cde20544e82bbc45cc7c4f306ac/users/bfa4282b832749fb8d93b0b104d182ba/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.395158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7663e6-a12a-4b71-ba0a-7b7370c76726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9869cde20544e82bbc45cc7c4f306ac, user_id=bfa4282b832749fb8d93b0b104d182ba, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:20.399114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7663e6-a12a-4b71-ba0a-7b7370c76726 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.422100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 898/1837] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:20 2022] PUT /identity/v3/projects/a9869cde20544e82bbc45cc7c4f306ac/users/bfa4282b832749fb8d93b0b104d182ba/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:20.432917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a870e-8c03-43a7-8b36-60c98347b722 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.433162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7049cf583174582aa07ccd1395e8eb5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:20.433263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a870e-8c03-43a7-8b36-60c98347b722 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.433459 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a870e-8c03-43a7-8b36-60c98347b722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.433926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7049cf583174582aa07ccd1395e8eb5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:20.434673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7049cf583174582aa07ccd1395e8eb5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:20.452137 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7049cf583174582aa07ccd1395e8eb5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:20.465434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1a4a870e-8c03-43a7-8b36-60c98347b722 None None] MFA Rules not processed for user `bfa4282b832749fb8d93b0b104d182ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:20.466798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1a4a870e-8c03-43a7-8b36-60c98347b722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:20.470221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-11946fd5-a56f-4b12-87a1-2b343c8e4b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7049cf583174582aa07ccd1395e8eb5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:20.471995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:20.490257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 940/1838] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:20 2022] DELETE /identity/v3/users/f7049cf583174582aa07ccd1395e8eb5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:20.494822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ee537-4b1a-46fa-ac04-a17b202efaa2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.495215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ee537-4b1a-46fa-ac04-a17b202efaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.495612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ee537-4b1a-46fa-ac04-a17b202efaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.506388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:20.517864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-6f2ee537-4b1a-46fa-ac04-a17b202efaa2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:20.519245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-6f2ee537-4b1a-46fa-ac04-a17b202efaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:20.559767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 899/1839] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:20.563767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a870e-8c03-43a7-8b36-60c98347b722 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:20.565856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1a4a870e-8c03-43a7-8b36-60c98347b722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:20.633031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 941/1840] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:20.647690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ee537-4b1a-46fa-ac04-a17b202efaa2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:20.649330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-6f2ee537-4b1a-46fa-ac04-a17b202efaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:20.665387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a870e-8c03-43a7-8b36-60c98347b722 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:20.671867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ae417-ac7f-4708-a100-e8440d6e1da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:20.672867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae417-ac7f-4708-a100-e8440d6e1da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.673615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae417-ac7f-4708-a100-e8440d6e1da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.674038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae417-ac7f-4708-a100-e8440d6e1da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.674972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ae417-ac7f-4708-a100-e8440d6e1da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:20.677144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ae417-ac7f-4708-a100-e8440d6e1da5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.723912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 900/1841] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:20 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:20.726302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ee537-4b1a-46fa-ac04-a17b202efaa2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:20.728736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ae417-ac7f-4708-a100-e8440d6e1da5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:20.806396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494c56-05ea-49a8-ae84-be8d7c2d728e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:20.807114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494c56-05ea-49a8-ae84-be8d7c2d728e service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.807404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494c56-05ea-49a8-ae84-be8d7c2d728e service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.807683 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494c56-05ea-49a8-ae84-be8d7c2d728e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.817763 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf494c56-05ea-49a8-ae84-be8d7c2d728e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:20.819271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf494c56-05ea-49a8-ae84-be8d7c2d728e service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.819425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ae417-ac7f-4708-a100-e8440d6e1da5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:20.824415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491de8a-3c00-4ed5-8354-ba9f193ad54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:20.825292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491de8a-3c00-4ed5-8354-ba9f193ad54e admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.825732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491de8a-3c00-4ed5-8354-ba9f193ad54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.826142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491de8a-3c00-4ed5-8354-ba9f193ad54e admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.827219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491de8a-3c00-4ed5-8354-ba9f193ad54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:20.829311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491de8a-3c00-4ed5-8354-ba9f193ad54e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.830389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 942/1842] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:20.862779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 901/1843] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:20 2022] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:20.866757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494c56-05ea-49a8-ae84-be8d7c2d728e service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:20.877683 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494c56-05ea-49a8-ae84-be8d7c2d728e service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:20.888693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb132ec0-5461-4f0a-8216-86381f2b9f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:20.889450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb132ec0-5461-4f0a-8216-86381f2b9f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.889774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb132ec0-5461-4f0a-8216-86381f2b9f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.890170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb132ec0-5461-4f0a-8216-86381f2b9f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.891866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb132ec0-5461-4f0a-8216-86381f2b9f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:20.895133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb132ec0-5461-4f0a-8216-86381f2b9f97 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.915319 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 943/1844] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:20.917025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491de8a-3c00-4ed5-8354-ba9f193ad54e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:20.928522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491de8a-3c00-4ed5-8354-ba9f193ad54e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:20.948697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15735d3-8c79-42e1-8b88-a85ff5cf6e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:20.949794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15735d3-8c79-42e1-8b88-a85ff5cf6e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:20.950123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15735d3-8c79-42e1-8b88-a85ff5cf6e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:20.950473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15735d3-8c79-42e1-8b88-a85ff5cf6e53 admin admin] PATH_INFO: `/v3/projects/aa6ad0c9d2834fae98ed5de5297c3105/users/b9574ccdb78148bcbecc7b9128a564c9/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:20.971790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15735d3-8c79-42e1-8b88-a85ff5cf6e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6ad0c9d2834fae98ed5de5297c3105, user_id=b9574ccdb78148bcbecc7b9128a564c9, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:20.974997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15735d3-8c79-42e1-8b88-a85ff5cf6e53 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:20.999799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 902/1845] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:20 2022] PUT /identity/v3/projects/aa6ad0c9d2834fae98ed5de5297c3105/users/b9574ccdb78148bcbecc7b9128a564c9/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:21.004564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb132ec0-5461-4f0a-8216-86381f2b9f97 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:21.029682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb132ec0-5461-4f0a-8216-86381f2b9f97 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:21.070879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:21.122740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d64511-e285-40c4-8372-2de3a61d0995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:21.123445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64511-e285-40c4-8372-2de3a61d0995 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:21.123735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64511-e285-40c4-8372-2de3a61d0995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:21.124028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64511-e285-40c4-8372-2de3a61d0995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:21.125836 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d64511-e285-40c4-8372-2de3a61d0995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:21.127555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d64511-e285-40c4-8372-2de3a61d0995 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:21.144130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 944/1846] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:21.144720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15735d3-8c79-42e1-8b88-a85ff5cf6e53 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:21.158399 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15735d3-8c79-42e1-8b88-a85ff5cf6e53 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:21.163918 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4bfee-2a04-4627-b49b-14154ce51356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:21.165290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4bfee-2a04-4627-b49b-14154ce51356 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:21.165743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4bfee-2a04-4627-b49b-14154ce51356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:21.166181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4bfee-2a04-4627-b49b-14154ce51356 admin admin] PATH_INFO: `/v3/projects/aa6ad0c9d2834fae98ed5de5297c3105/users/b9574ccdb78148bcbecc7b9128a564c9/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:21.168641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4bfee-2a04-4627-b49b-14154ce51356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6ad0c9d2834fae98ed5de5297c3105, user_id=b9574ccdb78148bcbecc7b9128a564c9, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:21.172149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4bfee-2a04-4627-b49b-14154ce51356 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:21.186337 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 903/1847] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:21 2022] PUT /identity/v3/projects/aa6ad0c9d2834fae98ed5de5297c3105/users/b9574ccdb78148bcbecc7b9128a564c9/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:21.198760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199c55-b34a-4735-8d37-cf6843053321 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:21.199122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199c55-b34a-4735-8d37-cf6843053321 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:21.199332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199c55-b34a-4735-8d37-cf6843053321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:21.230037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c4199c55-b34a-4735-8d37-cf6843053321 None None] MFA Rules not processed for user `b9574ccdb78148bcbecc7b9128a564c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:21.231335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c4199c55-b34a-4735-8d37-cf6843053321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:21.286013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4bfee-2a04-4627-b49b-14154ce51356 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:21.288008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b0b4bfee-2a04-4627-b49b-14154ce51356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:21.302267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:21.333702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 945/1848] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:21.343498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4199c55-b34a-4735-8d37-cf6843053321 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:21.345734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c4199c55-b34a-4735-8d37-cf6843053321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:21.406320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4bfee-2a04-4627-b49b-14154ce51356 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:21.414245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:21.415463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:21.415873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:21.416154 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] PATH_INFO: `/v3/projects/2d97363903ae472693d77b2dc14ee3a2` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:21.417558 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d97363903ae472693d77b2dc14ee3a2)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:21.419569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:21.423730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4199c55-b34a-4735-8d37-cf6843053321 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:21.427832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e0d2e-16b8-443b-a03d-3eec39ad3c00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:21.428908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e0d2e-16b8-443b-a03d-3eec39ad3c00 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:21.428908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e0d2e-16b8-443b-a03d-3eec39ad3c00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:21.429077 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e0d2e-16b8-443b-a03d-3eec39ad3c00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:21.439723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e0d2e-16b8-443b-a03d-3eec39ad3c00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:21.441180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e0d2e-16b8-443b-a03d-3eec39ad3c00 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:21.453298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 946/1849] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:21.479047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d97363903ae472693d77b2dc14ee3a2', 'request_id': 'req-d64c4eef-1c6d-436b-bd74-e0f582f2df64'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.487573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d97363903ae472693d77b2dc14ee3a2', 'request_id': 'req-d64c4eef-1c6d-436b-bd74-e0f582f2df64'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.497792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d97363903ae472693d77b2dc14ee3a2', 'request_id': 'req-d64c4eef-1c6d-436b-bd74-e0f582f2df64'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.515283 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] The token cache is being invalidate because project 2d97363903ae472693d77b2dc14ee3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:21.515458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.516031 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.517848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 904/1850] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:21 2022] DELETE /identity/v3/projects/2d97363903ae472693d77b2dc14ee3a2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:21.521786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e0d2e-16b8-443b-a03d-3eec39ad3c00 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:21.534604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e0d2e-16b8-443b-a03d-3eec39ad3c00 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:21.592289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:21.593900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:21.608458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:21.609424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:21.609776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:21.610243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] PATH_INFO: `/v3/users/b98cbc304ed84963b2453dbff46d7730` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:21.611558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98cbc304ed84963b2453dbff46d7730)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:21.613636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:21.618672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:21.685939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4eef-1c6d-436b-bd74-e0f582f2df64 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:21.686832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98cbc304ed84963b2453dbff46d7730'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.687561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98cbc304ed84963b2453dbff46d7730'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.688121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98cbc304ed84963b2453dbff46d7730'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.690919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:21.691827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:21.692108 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:21.692816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] PATH_INFO: `/v3/users/bfa4282b832749fb8d93b0b104d182ba` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:21.693691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa4282b832749fb8d93b0b104d182ba)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:21.695734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:21.700964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98cbc304ed84963b2453dbff46d7730'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.711638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f3ede4dc-bf7b-4ace-9169-6cf1a17e039f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98cbc304ed84963b2453dbff46d7730'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.725339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 947/1851] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:21 2022] DELETE /identity/v3/users/b98cbc304ed84963b2453dbff46d7730 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:21.743927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:21.756553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa4282b832749fb8d93b0b104d182ba'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.768727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa4282b832749fb8d93b0b104d182ba'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.769705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa4282b832749fb8d93b0b104d182ba'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.794150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa4282b832749fb8d93b0b104d182ba'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.803329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa4282b832749fb8d93b0b104d182ba'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:21.816640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 905/1852] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:21 2022] DELETE /identity/v3/users/bfa4282b832749fb8d93b0b104d182ba => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:21.818764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1e84e-6be3-4681-9d7d-e1202ba6649c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:21.819203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1e84e-6be3-4681-9d7d-e1202ba6649c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:21.819511 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1e84e-6be3-4681-9d7d-e1202ba6649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:21.850930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-85d1e84e-6be3-4681-9d7d-e1202ba6649c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:21.852616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-85d1e84e-6be3-4681-9d7d-e1202ba6649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:21.943263 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 948/1853] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:21.975194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:21.977082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:22.105993 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52aed9-5d04-489e-9902-518fddadf5c9 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:22.111729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996e576-3594-4333-b100-b662bc3f48dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:22.112406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996e576-3594-4333-b100-b662bc3f48dc service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.112932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996e576-3594-4333-b100-b662bc3f48dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.113571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996e576-3594-4333-b100-b662bc3f48dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.126011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996e576-3594-4333-b100-b662bc3f48dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:22.127826 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996e576-3594-4333-b100-b662bc3f48dc service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:22.140890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 906/1854] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:22.408159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1e84e-6be3-4681-9d7d-e1202ba6649c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:22.410685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-85d1e84e-6be3-4681-9d7d-e1202ba6649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:22.465463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1e84e-6be3-4681-9d7d-e1202ba6649c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:22.474153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:22.483873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.484297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.484786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] PATH_INFO: `/v3/projects/006d9b7eeadf459897078e0c7644310e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.486805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=006d9b7eeadf459897078e0c7644310e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:22.489284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:22.598178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006d9b7eeadf459897078e0c7644310e', 'request_id': 'req-01da258e-970b-41d4-87ce-84d9b78e4427'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.614336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006d9b7eeadf459897078e0c7644310e', 'request_id': 'req-01da258e-970b-41d4-87ce-84d9b78e4427'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.633619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006d9b7eeadf459897078e0c7644310e', 'request_id': 'req-01da258e-970b-41d4-87ce-84d9b78e4427'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.662302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] The token cache is being invalidate because project 006d9b7eeadf459897078e0c7644310e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:22.662798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.663640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-01da258e-970b-41d4-87ce-84d9b78e4427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.670293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 949/1855] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:22 2022] DELETE /identity/v3/projects/006d9b7eeadf459897078e0c7644310e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:22.672571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d854d8-b1fd-44f5-a56c-6f500a0ef428 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.673746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d854d8-b1fd-44f5-a56c-6f500a0ef428 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.674029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d854d8-b1fd-44f5-a56c-6f500a0ef428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.718608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b9d854d8-b1fd-44f5-a56c-6f500a0ef428 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:22.721044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b9d854d8-b1fd-44f5-a56c-6f500a0ef428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:22.815437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 907/1856] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:22.823785 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dd1ac-5ae9-498a-9339-21740b4db993 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.824081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dd1ac-5ae9-498a-9339-21740b4db993 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.825026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dd1ac-5ae9-498a-9339-21740b4db993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.844016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:22.877011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-001dd1ac-5ae9-498a-9339-21740b4db993 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:22.880571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-001dd1ac-5ae9-498a-9339-21740b4db993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:22.904111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d854d8-b1fd-44f5-a56c-6f500a0ef428 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:22.906023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b9d854d8-b1fd-44f5-a56c-6f500a0ef428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:22.922941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 950/1857] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:22.927485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dd1ac-5ae9-498a-9339-21740b4db993 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:22.937229 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d854d8-b1fd-44f5-a56c-6f500a0ef428 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:22.948857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dd1ac-5ae9-498a-9339-21740b4db993 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:22.951066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:22.951963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.952252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.953008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] PATH_INFO: `/v3/projects/a9869cde20544e82bbc45cc7c4f306ac` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.954625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9869cde20544e82bbc45cc7c4f306ac)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:22.956593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:22.963026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27936b9f-794f-4bc9-b231-14ff0cdfa22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:22.963881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936b9f-794f-4bc9-b231-14ff0cdfa22a admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.965977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936b9f-794f-4bc9-b231-14ff0cdfa22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.966369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936b9f-794f-4bc9-b231-14ff0cdfa22a admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.967675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27936b9f-794f-4bc9-b231-14ff0cdfa22a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:22.969960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27936b9f-794f-4bc9-b231-14ff0cdfa22a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:22.974155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27936b9f-794f-4bc9-b231-14ff0cdfa22a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:22.994254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 951/1858] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:23.000748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27936b9f-794f-4bc9-b231-14ff0cdfa22a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.012643 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27936b9f-794f-4bc9-b231-14ff0cdfa22a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.032421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9869cde20544e82bbc45cc7c4f306ac', 'request_id': 'req-c4efb3d9-8d28-4e70-858c-066c28d51115'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.034716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:23.039773 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9869cde20544e82bbc45cc7c4f306ac', 'request_id': 'req-c4efb3d9-8d28-4e70-858c-066c28d51115'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.050652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9869cde20544e82bbc45cc7c4f306ac', 'request_id': 'req-c4efb3d9-8d28-4e70-858c-066c28d51115'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.066025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] The token cache is being invalidate because project a9869cde20544e82bbc45cc7c4f306ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:23.066408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.067277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.069899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 908/1859] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:22 2022] DELETE /identity/v3/projects/a9869cde20544e82bbc45cc7c4f306ac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:23.076064 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.078771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:23.083789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe86b5-68bf-4682-94d1-77a6de1a27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.084548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe86b5-68bf-4682-94d1-77a6de1a27d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.084833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe86b5-68bf-4682-94d1-77a6de1a27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.085106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe86b5-68bf-4682-94d1-77a6de1a27d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.085807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe86b5-68bf-4682-94d1-77a6de1a27d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.087903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe86b5-68bf-4682-94d1-77a6de1a27d9 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.103457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efb3d9-8d28-4e70-858c-066c28d51115 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.111693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.113526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.114069 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.114594 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] PATH_INFO: `/v3/users/b9574ccdb78148bcbecc7b9128a564c9` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.117662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9574ccdb78148bcbecc7b9128a564c9)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.122188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.142246 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 952/1860] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:22 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:23.149772 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe86b5-68bf-4682-94d1-77a6de1a27d9 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.152006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b5fe86b5-68bf-4682-94d1-77a6de1a27d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:23.215734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9574ccdb78148bcbecc7b9128a564c9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.225001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9574ccdb78148bcbecc7b9128a564c9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.226206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9574ccdb78148bcbecc7b9128a564c9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.239321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe86b5-68bf-4682-94d1-77a6de1a27d9 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.242457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9574ccdb78148bcbecc7b9128a564c9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.250636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9574ccdb78148bcbecc7b9128a564c9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.251742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb17570-cfa6-441c-ad6a-a876e5c746a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.252464 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb17570-cfa6-441c-ad6a-a876e5c746a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.252922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb17570-cfa6-441c-ad6a-a876e5c746a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.253202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb17570-cfa6-441c-ad6a-a876e5c746a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.254280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb17570-cfa6-441c-ad6a-a876e5c746a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.257404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb17570-cfa6-441c-ad6a-a876e5c746a5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.259167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 909/1861] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:23 2022] DELETE /identity/v3/users/b9574ccdb78148bcbecc7b9128a564c9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:23.292693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 953/1862] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:23 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:23.297515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.300018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:23.387786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374616d-710a-44e3-aff7-43e6b7b21335 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.396048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cda4f-5aaa-424a-b35d-6fed2eac85f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.397294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cda4f-5aaa-424a-b35d-6fed2eac85f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.397576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cda4f-5aaa-424a-b35d-6fed2eac85f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.397897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cda4f-5aaa-424a-b35d-6fed2eac85f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.399446 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cda4f-5aaa-424a-b35d-6fed2eac85f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.403636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cda4f-5aaa-424a-b35d-6fed2eac85f6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.420960 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 910/1863] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:23.425378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb17570-cfa6-441c-ad6a-a876e5c746a5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.440805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb17570-cfa6-441c-ad6a-a876e5c746a5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.452999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7fdeb-283f-4e7a-89e2-65c378ad73bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.454353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7fdeb-283f-4e7a-89e2-65c378ad73bd admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.454885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7fdeb-283f-4e7a-89e2-65c378ad73bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.455340 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7fdeb-283f-4e7a-89e2-65c378ad73bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.456266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7fdeb-283f-4e7a-89e2-65c378ad73bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.458091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7fdeb-283f-4e7a-89e2-65c378ad73bd admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.478348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 954/1864] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:23.484081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cda4f-5aaa-424a-b35d-6fed2eac85f6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.499790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cda4f-5aaa-424a-b35d-6fed2eac85f6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.506458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833a663-54d6-403b-8b7b-ecf3c2e7c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.507458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833a663-54d6-403b-8b7b-ecf3c2e7c6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.507818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833a663-54d6-403b-8b7b-ecf3c2e7c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.508051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833a663-54d6-403b-8b7b-ecf3c2e7c6c2 admin admin] PATH_INFO: `/v3/projects/d976960ac09e4caf913feae05a8e105d/users/df04d3cb4d27431fb18fc515c4469fcb/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.526989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833a663-54d6-403b-8b7b-ecf3c2e7c6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d976960ac09e4caf913feae05a8e105d, user_id=df04d3cb4d27431fb18fc515c4469fcb, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.530424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833a663-54d6-403b-8b7b-ecf3c2e7c6c2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.549690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 911/1865] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:23 2022] PUT /identity/v3/projects/d976960ac09e4caf913feae05a8e105d/users/df04d3cb4d27431fb18fc515c4469fcb/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:23.563196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe967f3-402d-4fbc-899f-cf95aa338a6b None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.563553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe967f3-402d-4fbc-899f-cf95aa338a6b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.563753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe967f3-402d-4fbc-899f-cf95aa338a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.595361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-4fe967f3-402d-4fbc-899f-cf95aa338a6b None None] MFA Rules not processed for user `df04d3cb4d27431fb18fc515c4469fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:23.596335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4fe967f3-402d-4fbc-899f-cf95aa338a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:23.651209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:23.674926 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833a663-54d6-403b-8b7b-ecf3c2e7c6c2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.676665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f833a663-54d6-403b-8b7b-ecf3c2e7c6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:23.699893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 955/1866] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:23.704664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe967f3-402d-4fbc-899f-cf95aa338a6b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.718188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:23.764552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833a663-54d6-403b-8b7b-ecf3c2e7c6c2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.771096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.772374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.772646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.772992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] PATH_INFO: `/v3/projects/aa6ad0c9d2834fae98ed5de5297c3105` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.774673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6ad0c9d2834fae98ed5de5297c3105)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.776477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.782615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe967f3-402d-4fbc-899f-cf95aa338a6b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.787695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ca4bb-20ed-4345-96d5-ddd1c7c05c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.788434 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ca4bb-20ed-4345-96d5-ddd1c7c05c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.788746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ca4bb-20ed-4345-96d5-ddd1c7c05c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.789009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ca4bb-20ed-4345-96d5-ddd1c7c05c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.789630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ca4bb-20ed-4345-96d5-ddd1c7c05c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.792837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ca4bb-20ed-4345-96d5-ddd1c7c05c4b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.833599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 956/1867] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:23 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:23.837878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ca4bb-20ed-4345-96d5-ddd1c7c05c4b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.839084 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6ad0c9d2834fae98ed5de5297c3105', 'request_id': 'req-2c6fab73-e60e-4077-812f-9937daa80d42'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.846310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6ad0c9d2834fae98ed5de5297c3105', 'request_id': 'req-2c6fab73-e60e-4077-812f-9937daa80d42'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.856566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6ad0c9d2834fae98ed5de5297c3105', 'request_id': 'req-2c6fab73-e60e-4077-812f-9937daa80d42'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.873394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] The token cache is being invalidate because project aa6ad0c9d2834fae98ed5de5297c3105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:23.873690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.874375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2c6fab73-e60e-4077-812f-9937daa80d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.876061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 912/1868] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:23 2022] DELETE /identity/v3/projects/aa6ad0c9d2834fae98ed5de5297c3105 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:23.880752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371e156-67b4-4abc-a58f-b4ba07799125 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.881130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371e156-67b4-4abc-a58f-b4ba07799125 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.881439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371e156-67b4-4abc-a58f-b4ba07799125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.900333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0371e156-67b4-4abc-a58f-b4ba07799125 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:23.901557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0371e156-67b4-4abc-a58f-b4ba07799125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:23.922884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ca4bb-20ed-4345-96d5-ddd1c7c05c4b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.927871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382c107-0e4a-4768-8ee9-80ea10c10a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.928704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c107-0e4a-4768-8ee9-80ea10c10a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.929310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c107-0e4a-4768-8ee9-80ea10c10a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.929599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c107-0e4a-4768-8ee9-80ea10c10a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.930551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382c107-0e4a-4768-8ee9-80ea10c10a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.932691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382c107-0e4a-4768-8ee9-80ea10c10a0a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.967211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 957/1869] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:23 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:23.971463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382c107-0e4a-4768-8ee9-80ea10c10a0a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.974716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5382c107-0e4a-4768-8ee9-80ea10c10a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:23.988269 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382c107-0e4a-4768-8ee9-80ea10c10a0a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.001470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 913/1870] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:24.008571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37528e-4699-47c4-b136-e6b6f5dd6f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.009260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b056ac-b169-4ea8-b16c-8692fef96fa6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.009379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37528e-4699-47c4-b136-e6b6f5dd6f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.009553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37528e-4699-47c4-b136-e6b6f5dd6f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.009661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b056ac-b169-4ea8-b16c-8692fef96fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.009831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37528e-4699-47c4-b136-e6b6f5dd6f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.009929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b056ac-b169-4ea8-b16c-8692fef96fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.010615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37528e-4699-47c4-b136-e6b6f5dd6f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.012259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37528e-4699-47c4-b136-e6b6f5dd6f57 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.027080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 958/1871] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:24.027311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37528e-4699-47c4-b136-e6b6f5dd6f57 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.030528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-94b056ac-b169-4ea8-b16c-8692fef96fa6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:24.032155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-94b056ac-b169-4ea8-b16c-8692fef96fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:24.038789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37528e-4699-47c4-b136-e6b6f5dd6f57 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.040822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 914/1872] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:24.044098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e524318-f9dc-4e98-9d5b-2e9cd9b9da9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.044876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e524318-f9dc-4e98-9d5b-2e9cd9b9da9a admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.046328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b056ac-b169-4ea8-b16c-8692fef96fa6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.052192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e524318-f9dc-4e98-9d5b-2e9cd9b9da9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.052192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e524318-f9dc-4e98-9d5b-2e9cd9b9da9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.055116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e524318-f9dc-4e98-9d5b-2e9cd9b9da9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.058440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e524318-f9dc-4e98-9d5b-2e9cd9b9da9a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.059325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b056ac-b169-4ea8-b16c-8692fef96fa6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.065075 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0dffb-be38-4831-b95b-1c248b753fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.065768 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0dffb-be38-4831-b95b-1c248b753fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.066053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0dffb-be38-4831-b95b-1c248b753fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.066340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0dffb-be38-4831-b95b-1c248b753fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.067125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0dffb-be38-4831-b95b-1c248b753fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:24.067435 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0dffb-be38-4831-b95b-1c248b753fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.069920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0dffb-be38-4831-b95b-1c248b753fd5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.082527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 959/1873] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:24.087010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e524318-f9dc-4e98-9d5b-2e9cd9b9da9a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.093219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 915/1874] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:21:24.103438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e524318-f9dc-4e98-9d5b-2e9cd9b9da9a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.105626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0dffb-be38-4831-b95b-1c248b753fd5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.108551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb055efa-2d0f-4601-9388-cf242e18796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.109403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb055efa-2d0f-4601-9388-cf242e18796a admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.109686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb055efa-2d0f-4601-9388-cf242e18796a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.109989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb055efa-2d0f-4601-9388-cf242e18796a admin admin] PATH_INFO: `/v3/projects/eed34c924b50490a8bf073db47b0ebdc/users/4320b09939a8452a9f465c921bb6130a/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.118650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0dffb-be38-4831-b95b-1c248b753fd5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.124178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738dd36-99f7-4eac-ad73-afcc41244d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.125155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738dd36-99f7-4eac-ad73-afcc41244d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.125620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738dd36-99f7-4eac-ad73-afcc41244d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.126071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738dd36-99f7-4eac-ad73-afcc41244d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.127467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb055efa-2d0f-4601-9388-cf242e18796a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed34c924b50490a8bf073db47b0ebdc, user_id=4320b09939a8452a9f465c921bb6130a, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.127662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738dd36-99f7-4eac-ad73-afcc41244d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.129773 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738dd36-99f7-4eac-ad73-afcc41244d64 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.130738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb055efa-2d0f-4601-9388-cf242e18796a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.162970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 960/1875] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:24 2022] PUT /identity/v3/projects/eed34c924b50490a8bf073db47b0ebdc/users/4320b09939a8452a9f465c921bb6130a/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:24.164906 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 916/1876] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:24.172989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb055efa-2d0f-4601-9388-cf242e18796a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.173607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ca7b-fac5-4d06-aa0a-3db203e87379 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.175981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ca7b-fac5-4d06-aa0a-3db203e87379 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.176342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ca7b-fac5-4d06-aa0a-3db203e87379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.183756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:24.206399 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:24.210311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5166ca7b-fac5-4d06-aa0a-3db203e87379 None None] MFA Rules not processed for user `4320b09939a8452a9f465c921bb6130a`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:24.214849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5166ca7b-fac5-4d06-aa0a-3db203e87379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:24.244394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb055efa-2d0f-4601-9388-cf242e18796a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.288104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 917/1877] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:24.292618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166ca7b-fac5-4d06-aa0a-3db203e87379 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.307184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8ec38-93a9-4645-8900-ad1679a70bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.307873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8ec38-93a9-4645-8900-ad1679a70bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.308153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8ec38-93a9-4645-8900-ad1679a70bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.308444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8ec38-93a9-4645-8900-ad1679a70bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.309128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8ec38-93a9-4645-8900-ad1679a70bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.311182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8ec38-93a9-4645-8900-ad1679a70bb5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.332447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 961/1878] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:24.336638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8ec38-93a9-4645-8900-ad1679a70bb5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.346491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8ec38-93a9-4645-8900-ad1679a70bb5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.351403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b1a4-0511-49f4-9a94-adc3cb2ce588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.352078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b1a4-0511-49f4-9a94-adc3cb2ce588 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.352469 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b1a4-0511-49f4-9a94-adc3cb2ce588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.352748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b1a4-0511-49f4-9a94-adc3cb2ce588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.353493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2b1a4-0511-49f4-9a94-adc3cb2ce588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.355162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2b1a4-0511-49f4-9a94-adc3cb2ce588 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.359875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166ca7b-fac5-4d06-aa0a-3db203e87379 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.365020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857ab64-fd61-40df-a695-61515553fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.365651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ab64-fd61-40df-a695-61515553fc80 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.365913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ab64-fd61-40df-a695-61515553fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.366184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ab64-fd61-40df-a695-61515553fc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.366930 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857ab64-fd61-40df-a695-61515553fc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.368895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857ab64-fd61-40df-a695-61515553fc80 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.373771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 962/1879] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:24.374907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b1a4-0511-49f4-9a94-adc3cb2ce588 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.388361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b1a4-0511-49f4-9a94-adc3cb2ce588 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.394629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59816f03-bb3d-4ec2-b34e-0015870cb56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.395354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59816f03-bb3d-4ec2-b34e-0015870cb56f admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.395667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59816f03-bb3d-4ec2-b34e-0015870cb56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.395937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59816f03-bb3d-4ec2-b34e-0015870cb56f admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.396830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59816f03-bb3d-4ec2-b34e-0015870cb56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.398513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59816f03-bb3d-4ec2-b34e-0015870cb56f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.402620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 918/1880] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:24.403922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857ab64-fd61-40df-a695-61515553fc80 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.410705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 963/1881] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:24.414771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59816f03-bb3d-4ec2-b34e-0015870cb56f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.424874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59816f03-bb3d-4ec2-b34e-0015870cb56f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.492728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857ab64-fd61-40df-a695-61515553fc80 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.499329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf431de-620a-4fff-86c3-8fe8e5194b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.500076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf431de-620a-4fff-86c3-8fe8e5194b7f admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.500379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf431de-620a-4fff-86c3-8fe8e5194b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.500654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf431de-620a-4fff-86c3-8fe8e5194b7f admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.501837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42644735-b762-4d14-95d3-80db200a59a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.502301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf431de-620a-4fff-86c3-8fe8e5194b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.503663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42644735-b762-4d14-95d3-80db200a59a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.504558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42644735-b762-4d14-95d3-80db200a59a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.504558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42644735-b762-4d14-95d3-80db200a59a2 admin admin] PATH_INFO: `/v3/projects/fdbb4a2aabbb473d8067697fa1764e6d/users/c2ed94fef35a48478b42bb3e81a64cc6/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.506404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf431de-620a-4fff-86c3-8fe8e5194b7f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.529572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42644735-b762-4d14-95d3-80db200a59a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbb4a2aabbb473d8067697fa1764e6d, user_id=c2ed94fef35a48478b42bb3e81a64cc6, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.534589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 919/1882] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:24.534781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42644735-b762-4d14-95d3-80db200a59a2 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.540033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf431de-620a-4fff-86c3-8fe8e5194b7f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.551540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 964/1883] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:24 2022] PUT /identity/v3/projects/fdbb4a2aabbb473d8067697fa1764e6d/users/c2ed94fef35a48478b42bb3e81a64cc6/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:24.554094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf431de-620a-4fff-86c3-8fe8e5194b7f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.557333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c265-48c4-4fca-8717-60f85e23bf0f None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.557649 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c265-48c4-4fca-8717-60f85e23bf0f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.557869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c265-48c4-4fca-8717-60f85e23bf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.565030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:24.578066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-04a8c265-48c4-4fca-8717-60f85e23bf0f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:24.579325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-04a8c265-48c4-4fca-8717-60f85e23bf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:24.583368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:24.659470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 965/1884] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:24.673065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ed73-ea90-4e0f-9c2c-736358939987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.673338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c265-48c4-4fca-8717-60f85e23bf0f None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.673806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ed73-ea90-4e0f-9c2c-736358939987 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.674041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ed73-ea90-4e0f-9c2c-736358939987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.674571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ed73-ea90-4e0f-9c2c-736358939987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.675241 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026ed73-ea90-4e0f-9c2c-736358939987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.675900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-04a8c265-48c4-4fca-8717-60f85e23bf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:24.677102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026ed73-ea90-4e0f-9c2c-736358939987 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.690562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 920/1885] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:24.694728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ed73-ea90-4e0f-9c2c-736358939987 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.705939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ed73-ea90-4e0f-9c2c-736358939987 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.711805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f356b9-ab3b-4b56-8ece-2ee4bcfb5fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.715590 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f356b9-ab3b-4b56-8ece-2ee4bcfb5fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.715837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f356b9-ab3b-4b56-8ece-2ee4bcfb5fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.716507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f356b9-ab3b-4b56-8ece-2ee4bcfb5fe2 admin admin] PATH_INFO: `/v3/projects/88ef2ae48904429398c8523cb2149318/users/5979bf3d8fe04c64a37548f7d404bac2/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.737533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f356b9-ab3b-4b56-8ece-2ee4bcfb5fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ef2ae48904429398c8523cb2149318, user_id=5979bf3d8fe04c64a37548f7d404bac2, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.740534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f356b9-ab3b-4b56-8ece-2ee4bcfb5fe2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.758539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 921/1886] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:24 2022] PUT /identity/v3/projects/88ef2ae48904429398c8523cb2149318/users/5979bf3d8fe04c64a37548f7d404bac2/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:24.764984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f356b9-ab3b-4b56-8ece-2ee4bcfb5fe2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.779980 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c265-48c4-4fca-8717-60f85e23bf0f None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.858694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f356b9-ab3b-4b56-8ece-2ee4bcfb5fe2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.870680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517c99f-73b4-468f-87ac-e482f50961db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.870854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affac948-46c7-4bdc-a9b0-897fadcd257a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.870950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517c99f-73b4-468f-87ac-e482f50961db admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.870950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517c99f-73b4-468f-87ac-e482f50961db admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.871082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affac948-46c7-4bdc-a9b0-897fadcd257a service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.871171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517c99f-73b4-468f-87ac-e482f50961db admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.871936 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517c99f-73b4-468f-87ac-e482f50961db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.873587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517c99f-73b4-468f-87ac-e482f50961db admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.877969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affac948-46c7-4bdc-a9b0-897fadcd257a service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.878465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affac948-46c7-4bdc-a9b0-897fadcd257a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.887172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 922/1887] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:24.890060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affac948-46c7-4bdc-a9b0-897fadcd257a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.891598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517c99f-73b4-468f-87ac-e482f50961db admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.891762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affac948-46c7-4bdc-a9b0-897fadcd257a service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.903311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 966/1888] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:24.906451 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517c99f-73b4-468f-87ac-e482f50961db admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.912585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8523-2464-4fdd-bf23-a9c20a5d8548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.913502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8523-2464-4fdd-bf23-a9c20a5d8548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.914243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8523-2464-4fdd-bf23-a9c20a5d8548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.915094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8523-2464-4fdd-bf23-a9c20a5d8548 admin admin] PATH_INFO: `/v3/projects/88ef2ae48904429398c8523cb2149318/users/5979bf3d8fe04c64a37548f7d404bac2/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.917405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8523-2464-4fdd-bf23-a9c20a5d8548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ef2ae48904429398c8523cb2149318, user_id=5979bf3d8fe04c64a37548f7d404bac2, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.921357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8523-2464-4fdd-bf23-a9c20a5d8548 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.936819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 923/1889] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:24 2022] PUT /identity/v3/projects/88ef2ae48904429398c8523cb2149318/users/5979bf3d8fe04c64a37548f7d404bac2/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:24.948584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd222e-ead3-4bf3-8790-53c4dbb347bc None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.948873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd222e-ead3-4bf3-8790-53c4dbb347bc None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.949144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd222e-ead3-4bf3-8790-53c4dbb347bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.007619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-97bd222e-ead3-4bf3-8790-53c4dbb347bc None None] MFA Rules not processed for user `5979bf3d8fe04c64a37548f7d404bac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:25.009261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-97bd222e-ead3-4bf3-8790-53c4dbb347bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:25.109232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:25.168085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 967/1890] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:25.180136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8523-2464-4fdd-bf23-a9c20a5d8548 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.182106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f26b8523-2464-4fdd-bf23-a9c20a5d8548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:25.306345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8523-2464-4fdd-bf23-a9c20a5d8548 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.312111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06469e5b-972a-484d-bfa0-87ac715d34df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.313124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06469e5b-972a-484d-bfa0-87ac715d34df service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.313536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06469e5b-972a-484d-bfa0-87ac715d34df service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.313790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06469e5b-972a-484d-bfa0-87ac715d34df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.316353 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-06469e5b-972a-484d-bfa0-87ac715d34df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:25.359542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:25.422559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06469e5b-972a-484d-bfa0-87ac715d34df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:25.424275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06469e5b-972a-484d-bfa0-87ac715d34df service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.434971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 924/1891] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:25.752092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8c65-7a95-40a6-9bcc-af40085ac023 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.752586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8c65-7a95-40a6-9bcc-af40085ac023 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.752664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8c65-7a95-40a6-9bcc-af40085ac023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.792378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-fdee8c65-7a95-40a6-9bcc-af40085ac023 None None] MFA Rules not processed for user `c2ed94fef35a48478b42bb3e81a64cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:25.793958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-fdee8c65-7a95-40a6-9bcc-af40085ac023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:25.904631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 968/1892] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:25.907827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06469e5b-972a-484d-bfa0-87ac715d34df service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.989471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06469e5b-972a-484d-bfa0-87ac715d34df service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.996952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305d0aa-02b6-4d15-bb71-d956b6db85b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.997673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d0aa-02b6-4d15-bb71-d956b6db85b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.997954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d0aa-02b6-4d15-bb71-d956b6db85b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.998228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d0aa-02b6-4d15-bb71-d956b6db85b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.998983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305d0aa-02b6-4d15-bb71-d956b6db85b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:26.004561 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305d0aa-02b6-4d15-bb71-d956b6db85b1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:26.059801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 925/1893] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:25 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:26.063672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8c65-7a95-40a6-9bcc-af40085ac023 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:26.075071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8c65-7a95-40a6-9bcc-af40085ac023 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:26.149352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2a2c-871a-4fcf-adb7-c5208c462261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:26.149956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2a2c-871a-4fcf-adb7-c5208c462261 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:26.150242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2a2c-871a-4fcf-adb7-c5208c462261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:26.150548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2a2c-871a-4fcf-adb7-c5208c462261 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:26.151422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba2a2c-871a-4fcf-adb7-c5208c462261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:26.153374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba2a2c-871a-4fcf-adb7-c5208c462261 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:26.174944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 969/1894] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:26 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:26.178794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305d0aa-02b6-4d15-bb71-d956b6db85b1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:26.189624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305d0aa-02b6-4d15-bb71-d956b6db85b1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:26.194659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba674db-d1a3-43e8-bce0-4d8a8862743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:26.204149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba674db-d1a3-43e8-bce0-4d8a8862743f admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:26.204476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba674db-d1a3-43e8-bce0-4d8a8862743f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:26.204804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba674db-d1a3-43e8-bce0-4d8a8862743f admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:26.205661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba674db-d1a3-43e8-bce0-4d8a8862743f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:26.211202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba674db-d1a3-43e8-bce0-4d8a8862743f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:26.224104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 926/1895] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:26.232410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2a2c-871a-4fcf-adb7-c5208c462261 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:26.243583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2a2c-871a-4fcf-adb7-c5208c462261 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:26.249187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2292-b1fc-4d2f-a483-61cd04618084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:26.250118 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2292-b1fc-4d2f-a483-61cd04618084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:26.250406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2292-b1fc-4d2f-a483-61cd04618084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:26.250721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2292-b1fc-4d2f-a483-61cd04618084 admin admin] PATH_INFO: `/v3/projects/bc8dddb653a14eeea67470aa545a98f9/users/92838a2d6ed6465db327e4d62a328898/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:26.269768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b2292-b1fc-4d2f-a483-61cd04618084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8dddb653a14eeea67470aa545a98f9, user_id=92838a2d6ed6465db327e4d62a328898, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:26.272727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b2292-b1fc-4d2f-a483-61cd04618084 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:26.297717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 970/1896] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:26 2022] PUT /identity/v3/projects/bc8dddb653a14eeea67470aa545a98f9/users/92838a2d6ed6465db327e4d62a328898/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:26.303175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba674db-d1a3-43e8-bce0-4d8a8862743f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:26.318694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba674db-d1a3-43e8-bce0-4d8a8862743f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:26.381711 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f995bf-d87a-4357-9fb8-af84bb59fd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:26.382776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f995bf-d87a-4357-9fb8-af84bb59fd02 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:26.383315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f995bf-d87a-4357-9fb8-af84bb59fd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:26.383873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f995bf-d87a-4357-9fb8-af84bb59fd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:26.384754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f995bf-d87a-4357-9fb8-af84bb59fd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:26.386639 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f995bf-d87a-4357-9fb8-af84bb59fd02 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:26.399101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 927/1897] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:26.403414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2292-b1fc-4d2f-a483-61cd04618084 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:26.415842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2292-b1fc-4d2f-a483-61cd04618084 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:26.420745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfdf18-a3c8-4233-9b07-d4556ec0c406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:26.421800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfdf18-a3c8-4233-9b07-d4556ec0c406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:26.422183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfdf18-a3c8-4233-9b07-d4556ec0c406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:26.422684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfdf18-a3c8-4233-9b07-d4556ec0c406 admin admin] PATH_INFO: `/v3/projects/bc8dddb653a14eeea67470aa545a98f9/users/92838a2d6ed6465db327e4d62a328898/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:26.424987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfdf18-a3c8-4233-9b07-d4556ec0c406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8dddb653a14eeea67470aa545a98f9, user_id=92838a2d6ed6465db327e4d62a328898, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:26.427912 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfdf18-a3c8-4233-9b07-d4556ec0c406 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:26.441750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 971/1898] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:26 2022] PUT /identity/v3/projects/bc8dddb653a14eeea67470aa545a98f9/users/92838a2d6ed6465db327e4d62a328898/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:27.025041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f995bf-d87a-4357-9fb8-af84bb59fd02 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:27.082175 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:27.102351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f995bf-d87a-4357-9fb8-af84bb59fd02 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:27.162306 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f657a67-9e63-40c0-9c3a-b75e1ccb4349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:27.163108 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657a67-9e63-40c0-9c3a-b75e1ccb4349 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:27.163451 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657a67-9e63-40c0-9c3a-b75e1ccb4349 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:27.163794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657a67-9e63-40c0-9c3a-b75e1ccb4349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:27.221679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f657a67-9e63-40c0-9c3a-b75e1ccb4349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:27.223131 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f657a67-9e63-40c0-9c3a-b75e1ccb4349 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:27.232828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 928/1899] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:27.573013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aec42c-6281-4093-a136-f4e80348f6e9 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:27.573536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aec42c-6281-4093-a136-f4e80348f6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:27.573629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aec42c-6281-4093-a136-f4e80348f6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:27.593256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f657a67-9e63-40c0-9c3a-b75e1ccb4349 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:27.594790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0f657a67-9e63-40c0-9c3a-b75e1ccb4349 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:27.646611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-12aec42c-6281-4093-a136-f4e80348f6e9 None None] MFA Rules not processed for user `92838a2d6ed6465db327e4d62a328898`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:27.647855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-12aec42c-6281-4093-a136-f4e80348f6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:27.675201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:27.748298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f657a67-9e63-40c0-9c3a-b75e1ccb4349 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:27.759858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:27.760776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:27.761056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:27.761332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] PATH_INFO: `/v3/users/cdbe45f6588e476f86e6debad3d7c40c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:27.763614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdbe45f6588e476f86e6debad3d7c40c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:27.765615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:27.785359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 972/1900] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:27.800114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aec42c-6281-4093-a136-f4e80348f6e9 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:27.801782 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-12aec42c-6281-4093-a136-f4e80348f6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:27.826907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aec42c-6281-4093-a136-f4e80348f6e9 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:27.845640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5d8c-e112-4f96-aad3-c4c93870fbe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:27.851757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5d8c-e112-4f96-aad3-c4c93870fbe8 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:27.852256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5d8c-e112-4f96-aad3-c4c93870fbe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:27.853091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5d8c-e112-4f96-aad3-c4c93870fbe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:27.878149 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdbe45f6588e476f86e6debad3d7c40c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:27.883369 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:27.898814 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdbe45f6588e476f86e6debad3d7c40c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:27.899754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdbe45f6588e476f86e6debad3d7c40c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:27.932023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdbe45f6588e476f86e6debad3d7c40c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:27.950136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-56460951-92c8-4b75-8761-410a8e720740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdbe45f6588e476f86e6debad3d7c40c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:27.966311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 929/1901] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:27 2022] DELETE /identity/v3/users/cdbe45f6588e476f86e6debad3d7c40c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:27.969255 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d60d-53c3-4050-b7c4-9e0a7e9c016e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:27.969687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d60d-53c3-4050-b7c4-9e0a7e9c016e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:27.970099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d60d-53c3-4050-b7c4-9e0a7e9c016e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:27.992132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-83a0d60d-53c3-4050-b7c4-9e0a7e9c016e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:27.993566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-83a0d60d-53c3-4050-b7c4-9e0a7e9c016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:28.015078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad5d8c-e112-4f96-aad3-c4c93870fbe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:28.017640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad5d8c-e112-4f96-aad3-c4c93870fbe8 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:28.029765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 973/1902] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:28.081996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5d8c-e112-4f96-aad3-c4c93870fbe8 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:28.091325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 930/1903] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:28.093903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5d8c-e112-4f96-aad3-c4c93870fbe8 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:28.101843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0d60d-53c3-4050-b7c4-9e0a7e9c016e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:28.104302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-83a0d60d-53c3-4050-b7c4-9e0a7e9c016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:28.179137 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcf678-d932-4159-b5dc-61e7dfa3453b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:28.179904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf678-d932-4159-b5dc-61e7dfa3453b service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:28.180487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf678-d932-4159-b5dc-61e7dfa3453b service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:28.180855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf678-d932-4159-b5dc-61e7dfa3453b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:28.182986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c9bcf678-d932-4159-b5dc-61e7dfa3453b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:28.199706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0d60d-53c3-4050-b7c4-9e0a7e9c016e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:28.204153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e0690-92dd-462f-a946-df7682a08192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:28.204826 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0690-92dd-462f-a946-df7682a08192 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:28.205110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0690-92dd-462f-a946-df7682a08192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:28.205380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0690-92dd-462f-a946-df7682a08192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:28.220800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e0690-92dd-462f-a946-df7682a08192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:28.223733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e0690-92dd-462f-a946-df7682a08192 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:28.240456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 931/1904] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:28.261999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcf678-d932-4159-b5dc-61e7dfa3453b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:28.263698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcf678-d932-4159-b5dc-61e7dfa3453b service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:28.276598 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 974/1905] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:29.595740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e0690-92dd-462f-a946-df7682a08192 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:29.597395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a57e0690-92dd-462f-a946-df7682a08192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:29.611992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e0690-92dd-462f-a946-df7682a08192 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:29.622653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc2ba9-7ace-439f-8897-f2fa5077b1f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:29.622653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc2ba9-7ace-439f-8897-f2fa5077b1f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:29.622653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc2ba9-7ace-439f-8897-f2fa5077b1f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:29.622653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc2ba9-7ace-439f-8897-f2fa5077b1f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:29.625825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cbfc2ba9-7ace-439f-8897-f2fa5077b1f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:29.732726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc2ba9-7ace-439f-8897-f2fa5077b1f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:29.734254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc2ba9-7ace-439f-8897-f2fa5077b1f2 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:29.774219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 932/1906] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:29.822839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcf678-d932-4159-b5dc-61e7dfa3453b service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:29.827122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c9bcf678-d932-4159-b5dc-61e7dfa3453b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:29.868420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:29.888775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcf678-d932-4159-b5dc-61e7dfa3453b service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:29.917551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:29.923771 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:29.924581 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:29.927273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] PATH_INFO: `/v3/projects/70c1fc0cd21c40f0bb215d4541a520be` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:29.932966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c1fc0cd21c40f0bb215d4541a520be)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:29.936510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.065230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c1fc0cd21c40f0bb215d4541a520be', 'request_id': 'req-7055ed85-b9a7-4c52-8683-481370349850'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.078188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c1fc0cd21c40f0bb215d4541a520be', 'request_id': 'req-7055ed85-b9a7-4c52-8683-481370349850'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.087572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c1fc0cd21c40f0bb215d4541a520be', 'request_id': 'req-7055ed85-b9a7-4c52-8683-481370349850'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.102069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] The token cache is being invalidate because project 70c1fc0cd21c40f0bb215d4541a520be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:30.102714 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.103595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-7055ed85-b9a7-4c52-8683-481370349850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.106548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 975/1907] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:29 2022] DELETE /identity/v3/projects/70c1fc0cd21c40f0bb215d4541a520be => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:30.110703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab98415-2c21-47a7-9cef-81cf08d110ed None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.111217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab98415-2c21-47a7-9cef-81cf08d110ed None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.111713 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab98415-2c21-47a7-9cef-81cf08d110ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.119878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:30.132471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9ab98415-2c21-47a7-9cef-81cf08d110ed None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:30.135061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9ab98415-2c21-47a7-9cef-81cf08d110ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:30.267392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 933/1908] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:30.275237 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592c5f-b7e5-44d3-b122-153235d31d3e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.275959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592c5f-b7e5-44d3-b122-153235d31d3e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.276383 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592c5f-b7e5-44d3-b122-153235d31d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.300276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-bc592c5f-b7e5-44d3-b122-153235d31d3e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:30.305268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-bc592c5f-b7e5-44d3-b122-153235d31d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:30.319186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 976/1909] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:30.320470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab98415-2c21-47a7-9cef-81cf08d110ed None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:30.334866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab98415-2c21-47a7-9cef-81cf08d110ed None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:30.340725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c40c1-4437-46c5-8eb6-f139c16d1aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:30.341429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c40c1-4437-46c5-8eb6-f139c16d1aec admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.341727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c40c1-4437-46c5-8eb6-f139c16d1aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.341994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c40c1-4437-46c5-8eb6-f139c16d1aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.343090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c40c1-4437-46c5-8eb6-f139c16d1aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:30.343090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c40c1-4437-46c5-8eb6-f139c16d1aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:30.345891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c40c1-4437-46c5-8eb6-f139c16d1aec admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.363522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 934/1910] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:30.368126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc592c5f-b7e5-44d3-b122-153235d31d3e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:30.382228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc592c5f-b7e5-44d3-b122-153235d31d3e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:30.396274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed589826-3d8a-4500-ae4e-508d6a0fbad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:30.397516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed589826-3d8a-4500-ae4e-508d6a0fbad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.400455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed589826-3d8a-4500-ae4e-508d6a0fbad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.400805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed589826-3d8a-4500-ae4e-508d6a0fbad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.401564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed589826-3d8a-4500-ae4e-508d6a0fbad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:30.404083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed589826-3d8a-4500-ae4e-508d6a0fbad1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.440972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 977/1911] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:30 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:30.445384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c40c1-4437-46c5-8eb6-f139c16d1aec admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:30.455801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c40c1-4437-46c5-8eb6-f139c16d1aec admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:30.519269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bab37-cd38-4d61-9651-e6fb5bc0b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:30.519998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bab37-cd38-4d61-9651-e6fb5bc0b72d admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.520324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bab37-cd38-4d61-9651-e6fb5bc0b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.520603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bab37-cd38-4d61-9651-e6fb5bc0b72d admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.521313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bab37-cd38-4d61-9651-e6fb5bc0b72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:30.523356 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bab37-cd38-4d61-9651-e6fb5bc0b72d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.549618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 935/1912] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:30 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:30.555337 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed589826-3d8a-4500-ae4e-508d6a0fbad1 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:30.566398 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed589826-3d8a-4500-ae4e-508d6a0fbad1 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:30.572509 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73f14c-38a9-4158-8fe0-d5cf1af27091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:30.573199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73f14c-38a9-4158-8fe0-d5cf1af27091 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.573479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73f14c-38a9-4158-8fe0-d5cf1af27091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.573754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73f14c-38a9-4158-8fe0-d5cf1af27091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.574485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73f14c-38a9-4158-8fe0-d5cf1af27091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:30.576140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73f14c-38a9-4158-8fe0-d5cf1af27091 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.588045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 978/1913] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:30.592460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bab37-cd38-4d61-9651-e6fb5bc0b72d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:30.603621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bab37-cd38-4d61-9651-e6fb5bc0b72d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:30.608875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e9a4d-c04c-4502-ae8a-cbc49a361943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:30.609638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e9a4d-c04c-4502-ae8a-cbc49a361943 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.610022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e9a4d-c04c-4502-ae8a-cbc49a361943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.610311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e9a4d-c04c-4502-ae8a-cbc49a361943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.611093 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e9a4d-c04c-4502-ae8a-cbc49a361943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:30.612759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e9a4d-c04c-4502-ae8a-cbc49a361943 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.629615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 936/1914] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:30.631220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73f14c-38a9-4158-8fe0-d5cf1af27091 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:30.642957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73f14c-38a9-4158-8fe0-d5cf1af27091 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:30.648664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c79ad-4d14-4123-b9b4-46b7b7388e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:30.649668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c79ad-4d14-4123-b9b4-46b7b7388e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.649950 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c79ad-4d14-4123-b9b4-46b7b7388e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.650226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c79ad-4d14-4123-b9b4-46b7b7388e99 admin admin] PATH_INFO: `/v3/projects/d3f0c066c67f4ff3ba0592451e830e1b/users/b35d0306a43d49b78dbc5c04427b79ab/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.667292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c79ad-4d14-4123-b9b4-46b7b7388e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f0c066c67f4ff3ba0592451e830e1b, user_id=b35d0306a43d49b78dbc5c04427b79ab, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:30.669997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c79ad-4d14-4123-b9b4-46b7b7388e99 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.708530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 979/1915] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:30 2022] PUT /identity/v3/projects/d3f0c066c67f4ff3ba0592451e830e1b/users/b35d0306a43d49b78dbc5c04427b79ab/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:30.710640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6c2e-5ef6-467f-be96-810d55cccb56 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.710934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6c2e-5ef6-467f-be96-810d55cccb56 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.711425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6c2e-5ef6-467f-be96-810d55cccb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.746599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0cce6c2e-5ef6-467f-be96-810d55cccb56 None None] MFA Rules not processed for user `b35d0306a43d49b78dbc5c04427b79ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:30.748682 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0cce6c2e-5ef6-467f-be96-810d55cccb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:30.827170 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:30.831651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 937/1916] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:30.845219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c79ad-4d14-4123-b9b4-46b7b7388e99 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:30.847441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-695c79ad-4d14-4123-b9b4-46b7b7388e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:30.908815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c79ad-4d14-4123-b9b4-46b7b7388e99 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:30.912784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e233335-17f3-47b9-b56d-0fa652be60f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:30.913449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233335-17f3-47b9-b56d-0fa652be60f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.913774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233335-17f3-47b9-b56d-0fa652be60f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.914008 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233335-17f3-47b9-b56d-0fa652be60f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.923003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e233335-17f3-47b9-b56d-0fa652be60f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:30.924511 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e233335-17f3-47b9-b56d-0fa652be60f6 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.934212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 980/1917] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:33.604023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce6c2e-5ef6-467f-be96-810d55cccb56 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:33.707240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce6c2e-5ef6-467f-be96-810d55cccb56 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:33.715445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:33.717497 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:33.718086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:33.718694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] PATH_INFO: `/v3/users/b35d0306a43d49b78dbc5c04427b79ab` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:33.722572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35d0306a43d49b78dbc5c04427b79ab)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:33.734495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:33.763188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e233335-17f3-47b9-b56d-0fa652be60f6 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:33.764808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9e233335-17f3-47b9-b56d-0fa652be60f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:33.781118 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e233335-17f3-47b9-b56d-0fa652be60f6 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:33.787283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:33.788458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:33.788796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:33.789131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] PATH_INFO: `/v3/users/df04d3cb4d27431fb18fc515c4469fcb` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:33.790548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df04d3cb4d27431fb18fc515c4469fcb)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:33.792545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:33.813371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35d0306a43d49b78dbc5c04427b79ab'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:33.816953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:33.826634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35d0306a43d49b78dbc5c04427b79ab'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:33.827646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35d0306a43d49b78dbc5c04427b79ab'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:33.843774 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35d0306a43d49b78dbc5c04427b79ab'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:33.852482 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-96a9452f-a19f-4e77-a1f7-36569e025095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35d0306a43d49b78dbc5c04427b79ab'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:33.855481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df04d3cb4d27431fb18fc515c4469fcb'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:33.856274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df04d3cb4d27431fb18fc515c4469fcb'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:33.857081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df04d3cb4d27431fb18fc515c4469fcb'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:33.859337 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 938/1918] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:33 2022] DELETE /identity/v3/users/b35d0306a43d49b78dbc5c04427b79ab => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:33.863712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a865c6-0b97-4f69-8ffc-f0d9eaebfbaa None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:33.864034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a865c6-0b97-4f69-8ffc-f0d9eaebfbaa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:33.864310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a865c6-0b97-4f69-8ffc-f0d9eaebfbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:33.871895 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df04d3cb4d27431fb18fc515c4469fcb'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:33.883183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-950a6065-b5e0-4c63-aece-c8ef637da1f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df04d3cb4d27431fb18fc515c4469fcb'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:33.884317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-80a865c6-0b97-4f69-8ffc-f0d9eaebfbaa None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:33.886076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-80a865c6-0b97-4f69-8ffc-f0d9eaebfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:33.901189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 981/1919] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:33 2022] DELETE /identity/v3/users/df04d3cb4d27431fb18fc515c4469fcb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:33.906363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74974-ec8e-4ce6-9841-2044d05e6b74 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:33.906727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74974-ec8e-4ce6-9841-2044d05e6b74 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:33.907005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74974-ec8e-4ce6-9841-2044d05e6b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:33.933421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-f8b74974-ec8e-4ce6-9841-2044d05e6b74 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:33.934818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f8b74974-ec8e-4ce6-9841-2044d05e6b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:33.971463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 939/1920] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:33.988205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a865c6-0b97-4f69-8ffc-f0d9eaebfbaa None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:33.989761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-80a865c6-0b97-4f69-8ffc-f0d9eaebfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:34.023309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:34.032180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 982/1921] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:34.044673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74974-ec8e-4ce6-9841-2044d05e6b74 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:34.048687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f8b74974-ec8e-4ce6-9841-2044d05e6b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:34.095021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a865c6-0b97-4f69-8ffc-f0d9eaebfbaa None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:34.150331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74974-ec8e-4ce6-9841-2044d05e6b74 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:34.167165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef66da-0203-4997-b52c-75850f279631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:34.167165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef66da-0203-4997-b52c-75850f279631 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:34.167165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef66da-0203-4997-b52c-75850f279631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:34.167165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef66da-0203-4997-b52c-75850f279631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:34.202050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef66da-0203-4997-b52c-75850f279631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:34.203672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef66da-0203-4997-b52c-75850f279631 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:34.232414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 983/1922] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:34.273218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199600e-0cf7-43b1-96cd-6aa0ea80afdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:34.273971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199600e-0cf7-43b1-96cd-6aa0ea80afdd service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:34.274320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199600e-0cf7-43b1-96cd-6aa0ea80afdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:34.274320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199600e-0cf7-43b1-96cd-6aa0ea80afdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:34.320955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199600e-0cf7-43b1-96cd-6aa0ea80afdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:34.323031 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199600e-0cf7-43b1-96cd-6aa0ea80afdd service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:34.361956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 940/1923] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:35.360733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef66da-0203-4997-b52c-75850f279631 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:35.363652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e4ef66da-0203-4997-b52c-75850f279631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:35.404905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef66da-0203-4997-b52c-75850f279631 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:35.419016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:35.420065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:35.420930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:35.421267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] PATH_INFO: `/v3/projects/d976960ac09e4caf913feae05a8e105d` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:35.422659 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d976960ac09e4caf913feae05a8e105d)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:35.424798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:35.501664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:35.515976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd976960ac09e4caf913feae05a8e105d', 'request_id': 'req-a3da29eb-738a-4a95-b51c-a008bf6d7b22'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.525316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd976960ac09e4caf913feae05a8e105d', 'request_id': 'req-a3da29eb-738a-4a95-b51c-a008bf6d7b22'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.533990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd976960ac09e4caf913feae05a8e105d', 'request_id': 'req-a3da29eb-738a-4a95-b51c-a008bf6d7b22'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.549404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199600e-0cf7-43b1-96cd-6aa0ea80afdd service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:35.550888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9199600e-0cf7-43b1-96cd-6aa0ea80afdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:35.556881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] The token cache is being invalidate because project d976960ac09e4caf913feae05a8e105d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:35.557418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.558288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.560225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 984/1924] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:35 2022] DELETE /identity/v3/projects/d976960ac09e4caf913feae05a8e105d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:35.564974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:35.566684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:35.574760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199600e-0cf7-43b1-96cd-6aa0ea80afdd service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:35.685770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:35.686276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:35.686527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:35.686815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] PATH_INFO: `/v3/projects/d3f0c066c67f4ff3ba0592451e830e1b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:35.696741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da29eb-738a-4a95-b51c-a008bf6d7b22 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:35.698576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f0c066c67f4ff3ba0592451e830e1b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:35.700702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:35.706801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:35.709792 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:35.711033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:35.712807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] PATH_INFO: `/v3/users/4320b09939a8452a9f465c921bb6130a` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:35.714819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4320b09939a8452a9f465c921bb6130a)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:35.719861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:35.794532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f0c066c67f4ff3ba0592451e830e1b', 'request_id': 'req-d0661091-df22-40d7-a37c-418e874dfd68'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.804269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f0c066c67f4ff3ba0592451e830e1b', 'request_id': 'req-d0661091-df22-40d7-a37c-418e874dfd68'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.820251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f0c066c67f4ff3ba0592451e830e1b', 'request_id': 'req-d0661091-df22-40d7-a37c-418e874dfd68'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.855884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4320b09939a8452a9f465c921bb6130a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.861373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4320b09939a8452a9f465c921bb6130a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.862897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] The token cache is being invalidate because project d3f0c066c67f4ff3ba0592451e830e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:35.863191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.864425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4320b09939a8452a9f465c921bb6130a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.867142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0661091-df22-40d7-a37c-418e874dfd68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.877359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 941/1925] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:35 2022] DELETE /identity/v3/projects/d3f0c066c67f4ff3ba0592451e830e1b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:35.879902 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc953e99-5d30-46f4-8d81-a552a0dc9c53 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:35.880315 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc953e99-5d30-46f4-8d81-a552a0dc9c53 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:35.881367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc953e99-5d30-46f4-8d81-a552a0dc9c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:35.901603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4320b09939a8452a9f465c921bb6130a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.927229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a613bc75-8089-4aeb-9954-37616d75b991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4320b09939a8452a9f465c921bb6130a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.930048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-dc953e99-5d30-46f4-8d81-a552a0dc9c53 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:35.931533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dc953e99-5d30-46f4-8d81-a552a0dc9c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:35.942456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:35.953523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 985/1926] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:35 2022] DELETE /identity/v3/users/4320b09939a8452a9f465c921bb6130a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:36.025341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 942/1927] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:36.027245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6ae5-321c-4d37-8ec2-fe29c26d8e3b None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.027582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6ae5-321c-4d37-8ec2-fe29c26d8e3b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.027854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6ae5-321c-4d37-8ec2-fe29c26d8e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.089254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-f50d6ae5-321c-4d37-8ec2-fe29c26d8e3b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:36.097818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f50d6ae5-321c-4d37-8ec2-fe29c26d8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:36.200614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:36.238626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 986/1928] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:36.243429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc953e99-5d30-46f4-8d81-a552a0dc9c53 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:36.255803 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc953e99-5d30-46f4-8d81-a552a0dc9c53 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:36.266807 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bbba6-0576-4d7e-8a44-73a5e2f6d2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:36.267841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bbba6-0576-4d7e-8a44-73a5e2f6d2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.268249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bbba6-0576-4d7e-8a44-73a5e2f6d2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.268609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bbba6-0576-4d7e-8a44-73a5e2f6d2d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.269441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bbba6-0576-4d7e-8a44-73a5e2f6d2d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:36.269889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bbba6-0576-4d7e-8a44-73a5e2f6d2d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:36.273779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bbba6-0576-4d7e-8a44-73a5e2f6d2d2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:36.293153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 943/1929] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:21:36.298019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6ae5-321c-4d37-8ec2-fe29c26d8e3b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:36.309658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6ae5-321c-4d37-8ec2-fe29c26d8e3b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:36.315519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f65e87-8434-4775-9811-7d864f87fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:36.316331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f65e87-8434-4775-9811-7d864f87fb91 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.316711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f65e87-8434-4775-9811-7d864f87fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.316992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f65e87-8434-4775-9811-7d864f87fb91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.317780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f65e87-8434-4775-9811-7d864f87fb91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:36.319833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f65e87-8434-4775-9811-7d864f87fb91 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:36.384962 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 987/1930] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:36 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:36.385673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bbba6-0576-4d7e-8a44-73a5e2f6d2d2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:36.399672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bbba6-0576-4d7e-8a44-73a5e2f6d2d2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:36.556304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c884b-31b1-427a-a59d-9858a060a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:36.557587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c884b-31b1-427a-a59d-9858a060a4ec admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.559207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c884b-31b1-427a-a59d-9858a060a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.559499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c884b-31b1-427a-a59d-9858a060a4ec admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.560220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c884b-31b1-427a-a59d-9858a060a4ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:36.566785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c884b-31b1-427a-a59d-9858a060a4ec admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:36.612390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 944/1931] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:36 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:36.616861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f65e87-8434-4775-9811-7d864f87fb91 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:36.629355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f65e87-8434-4775-9811-7d864f87fb91 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:36.634998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15128fe-f9bb-46d0-956f-1f42e8385842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:36.635696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15128fe-f9bb-46d0-956f-1f42e8385842 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.635982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15128fe-f9bb-46d0-956f-1f42e8385842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.636259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15128fe-f9bb-46d0-956f-1f42e8385842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.637099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15128fe-f9bb-46d0-956f-1f42e8385842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:36.642558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15128fe-f9bb-46d0-956f-1f42e8385842 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:36.661363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 988/1932] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:36.662176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c884b-31b1-427a-a59d-9858a060a4ec admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:36.676119 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c884b-31b1-427a-a59d-9858a060a4ec admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:36.681989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694b9b5-7fb2-4242-9d61-bd30451e2ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:36.682868 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b9b5-7fb2-4242-9d61-bd30451e2ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.683245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b9b5-7fb2-4242-9d61-bd30451e2ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.683609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b9b5-7fb2-4242-9d61-bd30451e2ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.684871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694b9b5-7fb2-4242-9d61-bd30451e2ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:36.686215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694b9b5-7fb2-4242-9d61-bd30451e2ac4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:36.699529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 945/1933] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:36.703413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15128fe-f9bb-46d0-956f-1f42e8385842 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:36.716730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15128fe-f9bb-46d0-956f-1f42e8385842 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:36.721870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aa5c0-1c2d-4b20-aaf3-96540b2a5db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:36.723315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aa5c0-1c2d-4b20-aaf3-96540b2a5db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.723466 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aa5c0-1c2d-4b20-aaf3-96540b2a5db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.723742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aa5c0-1c2d-4b20-aaf3-96540b2a5db5 admin admin] PATH_INFO: `/v3/projects/ebe481a378f5454d975d405bc78d1203/users/14092cdf420c419caa3c79434dee6194/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.741368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97aa5c0-1c2d-4b20-aaf3-96540b2a5db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe481a378f5454d975d405bc78d1203, user_id=14092cdf420c419caa3c79434dee6194, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:36.744453 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97aa5c0-1c2d-4b20-aaf3-96540b2a5db5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:36.782976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30b50e-3586-4610-88a9-9b8262a7abd0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.783817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 989/1934] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:36 2022] PUT /identity/v3/projects/ebe481a378f5454d975d405bc78d1203/users/14092cdf420c419caa3c79434dee6194/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:36.787005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30b50e-3586-4610-88a9-9b8262a7abd0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.787200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30b50e-3586-4610-88a9-9b8262a7abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.858742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fa30b50e-3586-4610-88a9-9b8262a7abd0 None None] MFA Rules not processed for user `14092cdf420c419caa3c79434dee6194`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:36.860702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fa30b50e-3586-4610-88a9-9b8262a7abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:37.002282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 946/1935] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:37.018827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aa5c0-1c2d-4b20-aaf3-96540b2a5db5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:37.020625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b97aa5c0-1c2d-4b20-aaf3-96540b2a5db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:37.076948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30b50e-3586-4610-88a9-9b8262a7abd0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:37.078695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fa30b50e-3586-4610-88a9-9b8262a7abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:37.089144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:37.097217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aa5c0-1c2d-4b20-aaf3-96540b2a5db5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:37.102461 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d779-a130-4a93-a6e5-98e7c909b9ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:37.103747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d779-a130-4a93-a6e5-98e7c909b9ce service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:37.104208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d779-a130-4a93-a6e5-98e7c909b9ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:37.104737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d779-a130-4a93-a6e5-98e7c909b9ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:37.118542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089d779-a130-4a93-a6e5-98e7c909b9ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:37.120954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089d779-a130-4a93-a6e5-98e7c909b9ce service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:37.132533 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 990/1936] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:37.208016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30b50e-3586-4610-88a9-9b8262a7abd0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:37.217256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:37.218701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:37.219150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:37.219591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] PATH_INFO: `/v3/projects/eed34c924b50490a8bf073db47b0ebdc` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:37.220969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed34c924b50490a8bf073db47b0ebdc)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:37.223750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:37.293032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed34c924b50490a8bf073db47b0ebdc', 'request_id': 'req-c8253079-1316-4329-ac3e-3e4ba8e9d884'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.308769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed34c924b50490a8bf073db47b0ebdc', 'request_id': 'req-c8253079-1316-4329-ac3e-3e4ba8e9d884'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.325623 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed34c924b50490a8bf073db47b0ebdc', 'request_id': 'req-c8253079-1316-4329-ac3e-3e4ba8e9d884'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.350793 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] The token cache is being invalidate because project eed34c924b50490a8bf073db47b0ebdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:37.350793 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.351300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.354013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 947/1937] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:37 2022] DELETE /identity/v3/projects/eed34c924b50490a8bf073db47b0ebdc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:37.358928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d779-a130-4a93-a6e5-98e7c909b9ce service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:37.391388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d779-a130-4a93-a6e5-98e7c909b9ce service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:37.539458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:37.540528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:37.541084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:37.541382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] PATH_INFO: `/v3/users/5979bf3d8fe04c64a37548f7d404bac2` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:37.543043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5979bf3d8fe04c64a37548f7d404bac2)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:37.545357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:37.594248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:37.616492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5979bf3d8fe04c64a37548f7d404bac2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.645805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5979bf3d8fe04c64a37548f7d404bac2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.648150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5979bf3d8fe04c64a37548f7d404bac2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.702071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5979bf3d8fe04c64a37548f7d404bac2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.731855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e118b6b5-d018-4f31-885e-b654f48dc856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5979bf3d8fe04c64a37548f7d404bac2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.773974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 991/1938] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:37 2022] DELETE /identity/v3/users/5979bf3d8fe04c64a37548f7d404bac2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:38.197391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.198997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:38.222817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253079-1316-4329-ac3e-3e4ba8e9d884 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.287535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.288532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.288896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.289176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] PATH_INFO: `/v3/projects/88ef2ae48904429398c8523cb2149318` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.290621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ef2ae48904429398c8523cb2149318)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.292757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.348125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:38.362402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ef2ae48904429398c8523cb2149318', 'request_id': 'req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.370317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ef2ae48904429398c8523cb2149318', 'request_id': 'req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.382316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ef2ae48904429398c8523cb2149318', 'request_id': 'req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.399118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] The token cache is being invalidate because project 88ef2ae48904429398c8523cb2149318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:38.399524 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.400338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ad5f2cba-53ed-4264-a9f0-5c2328653e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.402310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 948/1939] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:38 2022] DELETE /identity/v3/projects/88ef2ae48904429398c8523cb2149318 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:38.407547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426c145-7ffd-4244-9bc5-2d9a2747b996 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.408756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426c145-7ffd-4244-9bc5-2d9a2747b996 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.408983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426c145-7ffd-4244-9bc5-2d9a2747b996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.428094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8426c145-7ffd-4244-9bc5-2d9a2747b996 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:38.429350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8426c145-7ffd-4244-9bc5-2d9a2747b996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:38.494562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 992/1940] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:38.502467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309e050-2c6b-43e7-90cf-199b43cb0a53 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.502780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309e050-2c6b-43e7-90cf-199b43cb0a53 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.503167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309e050-2c6b-43e7-90cf-199b43cb0a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.522739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4309e050-2c6b-43e7-90cf-199b43cb0a53 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:38.524007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4309e050-2c6b-43e7-90cf-199b43cb0a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:38.533794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 949/1941] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:38.538243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426c145-7ffd-4244-9bc5-2d9a2747b996 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.549458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426c145-7ffd-4244-9bc5-2d9a2747b996 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.554645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6d7e-ce66-413e-9289-d0e28599e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.555332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6d7e-ce66-413e-9289-d0e28599e31e admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.555616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6d7e-ce66-413e-9289-d0e28599e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.555892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6d7e-ce66-413e-9289-d0e28599e31e admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.556682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d6d7e-ce66-413e-9289-d0e28599e31e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:38.556988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d6d7e-ce66-413e-9289-d0e28599e31e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.558651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d6d7e-ce66-413e-9289-d0e28599e31e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.571939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 993/1942] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:38.576530 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309e050-2c6b-43e7-90cf-199b43cb0a53 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.587408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309e050-2c6b-43e7-90cf-199b43cb0a53 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.593947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eccec4-6b95-48d2-9e44-e1d9509d15d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.594923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eccec4-6b95-48d2-9e44-e1d9509d15d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.595282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eccec4-6b95-48d2-9e44-e1d9509d15d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.595567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eccec4-6b95-48d2-9e44-e1d9509d15d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.596634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eccec4-6b95-48d2-9e44-e1d9509d15d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.599147 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eccec4-6b95-48d2-9e44-e1d9509d15d1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.629171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 950/1943] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:38 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:38.634206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6d7e-ce66-413e-9289-d0e28599e31e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.652173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6d7e-ce66-413e-9289-d0e28599e31e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.714532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd779df-d363-45cd-8355-a54bc68edb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.715266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd779df-d363-45cd-8355-a54bc68edb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.715581 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd779df-d363-45cd-8355-a54bc68edb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.715859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd779df-d363-45cd-8355-a54bc68edb41 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.718124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd779df-d363-45cd-8355-a54bc68edb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.718720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd779df-d363-45cd-8355-a54bc68edb41 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.749552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 994/1944] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:38 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:38.753453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eccec4-6b95-48d2-9e44-e1d9509d15d1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.766978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eccec4-6b95-48d2-9e44-e1d9509d15d1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.772214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5441-1f9d-4a96-9ecd-785656c85e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.773030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5441-1f9d-4a96-9ecd-785656c85e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.773325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5441-1f9d-4a96-9ecd-785656c85e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.773617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5441-1f9d-4a96-9ecd-785656c85e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.776830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d5441-1f9d-4a96-9ecd-785656c85e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.776830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d5441-1f9d-4a96-9ecd-785656c85e50 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.793143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 951/1945] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:38.793931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd779df-d363-45cd-8355-a54bc68edb41 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.815584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd779df-d363-45cd-8355-a54bc68edb41 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.824185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889211a-4125-4262-b26f-24fccebc7dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.824536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889211a-4125-4262-b26f-24fccebc7dab admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.824823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889211a-4125-4262-b26f-24fccebc7dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.825099 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889211a-4125-4262-b26f-24fccebc7dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.827798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889211a-4125-4262-b26f-24fccebc7dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.833093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889211a-4125-4262-b26f-24fccebc7dab admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.847272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 995/1946] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:38.852611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5441-1f9d-4a96-9ecd-785656c85e50 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.868368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5441-1f9d-4a96-9ecd-785656c85e50 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.876826 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c60e-cbff-4168-a4a8-503cf2888df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.877873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c60e-cbff-4168-a4a8-503cf2888df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.878161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c60e-cbff-4168-a4a8-503cf2888df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.878572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c60e-cbff-4168-a4a8-503cf2888df9 admin admin] PATH_INFO: `/v3/projects/f3aa102899644ccea7b4aae8287458ab/users/15b4b9032c164af895b0b826ad337c02/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.910663 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9c60e-cbff-4168-a4a8-503cf2888df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3aa102899644ccea7b4aae8287458ab, user_id=15b4b9032c164af895b0b826ad337c02, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.913612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9c60e-cbff-4168-a4a8-503cf2888df9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.933830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 952/1947] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:38 2022] PUT /identity/v3/projects/f3aa102899644ccea7b4aae8287458ab/users/15b4b9032c164af895b0b826ad337c02/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:38.944046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0be3f7-0725-4819-b1d2-d4eef0f4a183 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.944759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0be3f7-0725-4819-b1d2-d4eef0f4a183 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.945084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0be3f7-0725-4819-b1d2-d4eef0f4a183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.991091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-aa0be3f7-0725-4819-b1d2-d4eef0f4a183 None None] MFA Rules not processed for user `15b4b9032c164af895b0b826ad337c02`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:38.995357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-aa0be3f7-0725-4819-b1d2-d4eef0f4a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:39.005481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:39.074827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 996/1948] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:39.089037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c60e-cbff-4168-a4a8-503cf2888df9 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:39.090802 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f6a9c60e-cbff-4168-a4a8-503cf2888df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:39.153290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c60e-cbff-4168-a4a8-503cf2888df9 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:39.157977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c261a-783f-401a-8e4c-4a1104d71246 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0055a33a380435d83a6d7384417c10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:39.158665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c261a-783f-401a-8e4c-4a1104d71246 service glance] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:39.158934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c261a-783f-401a-8e4c-4a1104d71246 service glance] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:39.159210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c261a-783f-401a-8e4c-4a1104d71246 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:39.168352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c261a-783f-401a-8e4c-4a1104d71246 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:39.169801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c261a-783f-401a-8e4c-4a1104d71246 service glance] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:39.180281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 953/1949] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:39.906007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c2f63-8c61-402b-b934-60e74c47286d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:39.906704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c2f63-8c61-402b-b934-60e74c47286d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:39.906704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c2f63-8c61-402b-b934-60e74c47286d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:39.925858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-4f4c2f63-8c61-402b-b934-60e74c47286d None None] MFA Rules not processed for user `14092cdf420c419caa3c79434dee6194`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:39.927149 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4f4c2f63-8c61-402b-b934-60e74c47286d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:39.993624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 997/1950] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:45.648005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57863470-0216-43aa-bc94-50ff16700276 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:45.648574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57863470-0216-43aa-bc94-50ff16700276 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:45.648674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57863470-0216-43aa-bc94-50ff16700276 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:45.651046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 954/1951] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:21:45.673351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb29d50-4b7f-4c80-ac9d-7ba13d109970 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:45.673971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb29d50-4b7f-4c80-ac9d-7ba13d109970 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:45.673971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb29d50-4b7f-4c80-ac9d-7ba13d109970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:45.700118 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-aeb29d50-4b7f-4c80-ac9d-7ba13d109970 None None] MFA Rules not processed for user `9b257dee0ca3400f860ef9bd8c7a4e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:45.702082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-aeb29d50-4b7f-4c80-ac9d-7ba13d109970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:45.795523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57863470-0216-43aa-bc94-50ff16700276 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:45.797660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-57863470-0216-43aa-bc94-50ff16700276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:45.831040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 998/1952] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:21:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:45.844391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb29d50-4b7f-4c80-ac9d-7ba13d109970 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:45.846241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-aeb29d50-4b7f-4c80-ac9d-7ba13d109970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:45.868830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb29d50-4b7f-4c80-ac9d-7ba13d109970 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:45.874290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7118eda-29d4-401b-b7dd-ad651c957fdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:45.875033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7118eda-29d4-401b-b7dd-ad651c957fdb service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:45.875316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7118eda-29d4-401b-b7dd-ad651c957fdb service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:45.875594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7118eda-29d4-401b-b7dd-ad651c957fdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:45.885123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7118eda-29d4-401b-b7dd-ad651c957fdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:45.886814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7118eda-29d4-401b-b7dd-ad651c957fdb service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:45.906720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 999/1953] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:45.908116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57863470-0216-43aa-bc94-50ff16700276 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:45.916213 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:45.917028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:45.917307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:45.917664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] PATH_INFO: `/v3/users/c2ed94fef35a48478b42bb3e81a64cc6` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:45.919273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ed94fef35a48478b42bb3e81a64cc6)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:45.921220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:45.926831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:46.005317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ed94fef35a48478b42bb3e81a64cc6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.015751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ed94fef35a48478b42bb3e81a64cc6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.016492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ed94fef35a48478b42bb3e81a64cc6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.031264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ed94fef35a48478b42bb3e81a64cc6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.045366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ed94fef35a48478b42bb3e81a64cc6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.052055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 955/1954] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:45 2022] DELETE /identity/v3/users/c2ed94fef35a48478b42bb3e81a64cc6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:46.303831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7118eda-29d4-401b-b7dd-ad651c957fdb service placement] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:46.316439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7118eda-29d4-401b-b7dd-ad651c957fdb service placement] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:46.372455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:46.424900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:46.427136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:46.428447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:46.429279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] PATH_INFO: `/v3/projects/fdbb4a2aabbb473d8067697fa1764e6d` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:46.430968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbb4a2aabbb473d8067697fa1764e6d)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:46.433279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:46.508760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbb4a2aabbb473d8067697fa1764e6d', 'request_id': 'req-8f380f0f-e718-44c7-a5d8-fda55caba937'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.517117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbb4a2aabbb473d8067697fa1764e6d', 'request_id': 'req-8f380f0f-e718-44c7-a5d8-fda55caba937'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.524082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbb4a2aabbb473d8067697fa1764e6d', 'request_id': 'req-8f380f0f-e718-44c7-a5d8-fda55caba937'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.536463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] The token cache is being invalidate because project fdbb4a2aabbb473d8067697fa1764e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:46.536769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.537480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.539158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1000/1955] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:46 2022] DELETE /identity/v3/projects/fdbb4a2aabbb473d8067697fa1764e6d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:46.543689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:46.545319 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:46.560771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9fe80-8bed-4b1d-b48e-468c9f53468f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:46.642686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:46.643891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:46.644249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:46.644586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] PATH_INFO: `/v3/users/92838a2d6ed6465db327e4d62a328898` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:46.645984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=92838a2d6ed6465db327e4d62a328898)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:46.648216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:46.703204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92838a2d6ed6465db327e4d62a328898'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.711931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92838a2d6ed6465db327e4d62a328898'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.712575 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92838a2d6ed6465db327e4d62a328898'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.725332 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92838a2d6ed6465db327e4d62a328898'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.733372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-057eea5a-7dd6-4a81-a97d-880ec27bba1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92838a2d6ed6465db327e4d62a328898'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:46.739897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 956/1956] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:46 2022] DELETE /identity/v3/users/92838a2d6ed6465db327e4d62a328898 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:47.041035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:47.042715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:47.057110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380f0f-e718-44c7-a5d8-fda55caba937 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:47.182645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:47.183858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:47.184279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:47.184841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] PATH_INFO: `/v3/projects/bc8dddb653a14eeea67470aa545a98f9` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:47.188364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc8dddb653a14eeea67470aa545a98f9)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:47.190480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:47.258111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8dddb653a14eeea67470aa545a98f9', 'request_id': 'req-d74c7f5c-e087-4dd5-9372-c31d56385d52'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:47.268052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8dddb653a14eeea67470aa545a98f9', 'request_id': 'req-d74c7f5c-e087-4dd5-9372-c31d56385d52'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:47.276847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8dddb653a14eeea67470aa545a98f9', 'request_id': 'req-d74c7f5c-e087-4dd5-9372-c31d56385d52'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:47.282633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:47.291920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] The token cache is being invalidate because project bc8dddb653a14eeea67470aa545a98f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:47.292630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:47.293405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d74c7f5c-e087-4dd5-9372-c31d56385d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:47.295510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1001/1957] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:47 2022] DELETE /identity/v3/projects/bc8dddb653a14eeea67470aa545a98f9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:47.304354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd718f-5050-4792-b2af-f7247b3f83cf None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:47.305125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd718f-5050-4792-b2af-f7247b3f83cf None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:47.305417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd718f-5050-4792-b2af-f7247b3f83cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:47.312850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:47.329480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bcdd718f-5050-4792-b2af-f7247b3f83cf None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:47.331943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bcdd718f-5050-4792-b2af-f7247b3f83cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:47.414562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 957/1958] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:47.423074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d75c95-5327-46b0-8f48-555bcdf8da04 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:47.423801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d75c95-5327-46b0-8f48-555bcdf8da04 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:47.424124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d75c95-5327-46b0-8f48-555bcdf8da04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:47.446977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-74d75c95-5327-46b0-8f48-555bcdf8da04 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:47.448288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-74d75c95-5327-46b0-8f48-555bcdf8da04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:47.463074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1002/1959] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:47.467035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd718f-5050-4792-b2af-f7247b3f83cf None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:47.481973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd718f-5050-4792-b2af-f7247b3f83cf None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:47.489444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516e6b8-3c69-44b4-aa1c-41a2dad314e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:47.490014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516e6b8-3c69-44b4-aa1c-41a2dad314e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:47.490539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516e6b8-3c69-44b4-aa1c-41a2dad314e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:47.490779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516e6b8-3c69-44b4-aa1c-41a2dad314e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:47.491532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516e6b8-3c69-44b4-aa1c-41a2dad314e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:47.491849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516e6b8-3c69-44b4-aa1c-41a2dad314e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:47.493599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516e6b8-3c69-44b4-aa1c-41a2dad314e3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:47.512550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 958/1960] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:47.514035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d75c95-5327-46b0-8f48-555bcdf8da04 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:47.528324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d75c95-5327-46b0-8f48-555bcdf8da04 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:47.534800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b5a99-98b5-4555-87dc-653ae5d86532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:47.535609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b5a99-98b5-4555-87dc-653ae5d86532 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:47.535956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b5a99-98b5-4555-87dc-653ae5d86532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:47.536211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b5a99-98b5-4555-87dc-653ae5d86532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:47.537371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b5a99-98b5-4555-87dc-653ae5d86532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:47.539284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b5a99-98b5-4555-87dc-653ae5d86532 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:47.574962 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1003/1961] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:47 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:47.576999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516e6b8-3c69-44b4-aa1c-41a2dad314e3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:47.588790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516e6b8-3c69-44b4-aa1c-41a2dad314e3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:47.672507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3e261-94ee-40df-836e-909417318595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:47.673384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3e261-94ee-40df-836e-909417318595 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:47.673761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3e261-94ee-40df-836e-909417318595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:47.674127 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3e261-94ee-40df-836e-909417318595 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:47.675146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3e261-94ee-40df-836e-909417318595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:47.678211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3e261-94ee-40df-836e-909417318595 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:47.709788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 959/1962] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:47 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:47.711324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b5a99-98b5-4555-87dc-653ae5d86532 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:47.729866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b5a99-98b5-4555-87dc-653ae5d86532 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:47.737139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a1c3e-7f17-4a7a-b436-7947c5d66f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:47.737843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1c3e-7f17-4a7a-b436-7947c5d66f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:47.738165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1c3e-7f17-4a7a-b436-7947c5d66f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:47.738441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1c3e-7f17-4a7a-b436-7947c5d66f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:47.739217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a1c3e-7f17-4a7a-b436-7947c5d66f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:47.740854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a1c3e-7f17-4a7a-b436-7947c5d66f78 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:47.752376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1004/1963] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:47.756593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3e261-94ee-40df-836e-909417318595 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:47.768379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3e261-94ee-40df-836e-909417318595 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:47.772997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be623359-e0fc-4aea-9650-8653c95b45da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:47.773825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be623359-e0fc-4aea-9650-8653c95b45da admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:47.774105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be623359-e0fc-4aea-9650-8653c95b45da admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:47.774377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be623359-e0fc-4aea-9650-8653c95b45da admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:47.775140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be623359-e0fc-4aea-9650-8653c95b45da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:47.776755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be623359-e0fc-4aea-9650-8653c95b45da admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:47.790427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 960/1964] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:47.796794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a1c3e-7f17-4a7a-b436-7947c5d66f78 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:47.811571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a1c3e-7f17-4a7a-b436-7947c5d66f78 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:47.817318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e41b0-9d3c-43e8-b3e6-90b5043c7a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:47.818322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e41b0-9d3c-43e8-b3e6-90b5043c7a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:47.818711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e41b0-9d3c-43e8-b3e6-90b5043c7a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:47.819080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e41b0-9d3c-43e8-b3e6-90b5043c7a4f admin admin] PATH_INFO: `/v3/projects/c5370eb5245247a68d7f224cdd457ea1/users/0d1dcf4b8dbb4e1698e7b0c4dc9c63a4/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:47.835346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e41b0-9d3c-43e8-b3e6-90b5043c7a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5370eb5245247a68d7f224cdd457ea1, user_id=0d1dcf4b8dbb4e1698e7b0c4dc9c63a4, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:47.838212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e41b0-9d3c-43e8-b3e6-90b5043c7a4f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:47.853074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1005/1965] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:47 2022] PUT /identity/v3/projects/c5370eb5245247a68d7f224cdd457ea1/users/0d1dcf4b8dbb4e1698e7b0c4dc9c63a4/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:47.858740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bbb90-2e7c-417e-b77e-46cfc04493b7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:47.859031 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bbb90-2e7c-417e-b77e-46cfc04493b7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:47.859311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bbb90-2e7c-417e-b77e-46cfc04493b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:47.878797 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-369bbb90-2e7c-417e-b77e-46cfc04493b7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:47.880043 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-369bbb90-2e7c-417e-b77e-46cfc04493b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:47.944609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 961/1966] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:47.954423 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e41b0-9d3c-43e8-b3e6-90b5043c7a4f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:47.956339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-db5e41b0-9d3c-43e8-b3e6-90b5043c7a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:48.020690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e41b0-9d3c-43e8-b3e6-90b5043c7a4f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:48.024700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b0eb2-5571-4271-a160-e771f2e5e75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:48.025368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b0eb2-5571-4271-a160-e771f2e5e75d service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:48.025650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b0eb2-5571-4271-a160-e771f2e5e75d service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:48.025930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b0eb2-5571-4271-a160-e771f2e5e75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:48.036745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b0eb2-5571-4271-a160-e771f2e5e75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:48.038209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b0eb2-5571-4271-a160-e771f2e5e75d service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:48.048838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1006/1967] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:49.195729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2863d-4063-4453-9fea-b674ec2f00ac None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:49.196355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2863d-4063-4453-9fea-b674ec2f00ac None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:49.196872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2863d-4063-4453-9fea-b674ec2f00ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:49.225596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:49.241253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-aec2863d-4063-4453-9fea-b674ec2f00ac None None] MFA Rules not processed for user `0d1dcf4b8dbb4e1698e7b0c4dc9c63a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:49.243621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-aec2863d-4063-4453-9fea-b674ec2f00ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:49.424640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 962/1968] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:49.434838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b0eb2-5571-4271-a160-e771f2e5e75d service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:49.436478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-155b0eb2-5571-4271-a160-e771f2e5e75d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:49.574975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b0eb2-5571-4271-a160-e771f2e5e75d service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:49.579754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519b8b6-e585-4f33-bcd3-d07bafea7af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:49.580536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519b8b6-e585-4f33-bcd3-d07bafea7af4 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:49.580922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519b8b6-e585-4f33-bcd3-d07bafea7af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:49.581372 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519b8b6-e585-4f33-bcd3-d07bafea7af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:49.592513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519b8b6-e585-4f33-bcd3-d07bafea7af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:49.594066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519b8b6-e585-4f33-bcd3-d07bafea7af4 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:49.609491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1007/1969] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:51.231836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d28f-a52d-4e74-99cd-efb403e2973d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:51.232384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d28f-a52d-4e74-99cd-efb403e2973d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:51.232384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d28f-a52d-4e74-99cd-efb403e2973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:51.251271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5188d28f-a52d-4e74-99cd-efb403e2973d None None] MFA Rules not processed for user `0d1dcf4b8dbb4e1698e7b0c4dc9c63a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:51.252477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5188d28f-a52d-4e74-99cd-efb403e2973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:51.264703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 963/1970] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:59.599760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:DELETE=1,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:01.245251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=31 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:11.487706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe9d5-0fff-472e-94bd-caf462043488 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:11.488787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe9d5-0fff-472e-94bd-caf462043488 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:11.489501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe9d5-0fff-472e-94bd-caf462043488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:11.521858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-320fe9d5-0fff-472e-94bd-caf462043488 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:11.523202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-320fe9d5-0fff-472e-94bd-caf462043488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:11.626655 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1008/1971] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:22:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:11.680279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d28f-a52d-4e74-99cd-efb403e2973d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:11.683239 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5188d28f-a52d-4e74-99cd-efb403e2973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:11.784197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d28f-a52d-4e74-99cd-efb403e2973d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:11.790806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf9b18-8084-4499-911d-3907dd1af9e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:11.791706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf9b18-8084-4499-911d-3907dd1af9e6 service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:11.792058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf9b18-8084-4499-911d-3907dd1af9e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:11.792745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf9b18-8084-4499-911d-3907dd1af9e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:11.802863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf9b18-8084-4499-911d-3907dd1af9e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:11.804682 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf9b18-8084-4499-911d-3907dd1af9e6 service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:11.814414 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 964/1972] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:22:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:12.561531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a7ef-b59b-41db-8434-747b6dad13d4 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:12.562435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a7ef-b59b-41db-8434-747b6dad13d4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:12.562802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a7ef-b59b-41db-8434-747b6dad13d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:12.594075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c525a7ef-b59b-41db-8434-747b6dad13d4 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:12.595822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c525a7ef-b59b-41db-8434-747b6dad13d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:12.627292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1009/1973] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 10:22:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:12.634985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf9b18-8084-4499-911d-3907dd1af9e6 service swift] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:12.653485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf9b18-8084-4499-911d-3907dd1af9e6 service swift] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:12.670119 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff8c02-02ce-4c37-8cb2-66c3b5b42af3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:12.671049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8c02-02ce-4c37-8cb2-66c3b5b42af3 service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:12.671350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8c02-02ce-4c37-8cb2-66c3b5b42af3 service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:12.671614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8c02-02ce-4c37-8cb2-66c3b5b42af3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:12.683432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff8c02-02ce-4c37-8cb2-66c3b5b42af3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:12.685215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff8c02-02ce-4c37-8cb2-66c3b5b42af3 service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:12.694997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 965/1974] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:22:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:12.783209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525a7ef-b59b-41db-8434-747b6dad13d4 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:12.786025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c525a7ef-b59b-41db-8434-747b6dad13d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:12.805855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525a7ef-b59b-41db-8434-747b6dad13d4 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:12.815999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:12.817189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:12.817501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:12.817809 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] PATH_INFO: `/v3/users/96d2a62272e248d3b11aca8737e22fb2` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:12.820026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d2a62272e248d3b11aca8737e22fb2)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:12.822493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:12.904479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d2a62272e248d3b11aca8737e22fb2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:12.905169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d2a62272e248d3b11aca8737e22fb2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:12.906164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d2a62272e248d3b11aca8737e22fb2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:12.924446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d2a62272e248d3b11aca8737e22fb2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:12.937995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d2a62272e248d3b11aca8737e22fb2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:12.955409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1010/1975] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:12 2022] DELETE /identity/v3/users/96d2a62272e248d3b11aca8737e22fb2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:12.973846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076dee8-7f77-4a33-b749-fe6a57fda1cb None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:12.974139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076dee8-7f77-4a33-b749-fe6a57fda1cb None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:12.974417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076dee8-7f77-4a33-b749-fe6a57fda1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:12.996095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6076dee8-7f77-4a33-b749-fe6a57fda1cb None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:12.997422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6076dee8-7f77-4a33-b749-fe6a57fda1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:13.058944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 966/1976] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:22:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:13.071924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:13.073591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:13.148381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cab851-50e8-46ab-a943-94257fc7645c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:13.150773 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076dee8-7f77-4a33-b749-fe6a57fda1cb None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:13.152619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6076dee8-7f77-4a33-b749-fe6a57fda1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:13.155318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8560d-980b-430a-b204-ee7e6a17c9bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:13.156357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8560d-980b-430a-b204-ee7e6a17c9bd service swift] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.156671 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8560d-980b-430a-b204-ee7e6a17c9bd service swift] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.156938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8560d-980b-430a-b204-ee7e6a17c9bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.173841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8560d-980b-430a-b204-ee7e6a17c9bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:13.179618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8560d-980b-430a-b204-ee7e6a17c9bd service swift] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:13.186867 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:13.191720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1011/1977] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:22:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:13.232227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076dee8-7f77-4a33-b749-fe6a57fda1cb None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:13.237804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:13.238851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.239207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.239548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] PATH_INFO: `/v3/projects/3e253dfe684b469383c18ff8c2a3dbd9` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.240888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e253dfe684b469383c18ff8c2a3dbd9)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:13.243097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:13.272481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:13.304909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e253dfe684b469383c18ff8c2a3dbd9', 'request_id': 'req-6f6cc4ee-90a8-433a-9395-db895956da42'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:13.313094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e253dfe684b469383c18ff8c2a3dbd9', 'request_id': 'req-6f6cc4ee-90a8-433a-9395-db895956da42'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:13.326262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e253dfe684b469383c18ff8c2a3dbd9', 'request_id': 'req-6f6cc4ee-90a8-433a-9395-db895956da42'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:13.346742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] The token cache is being invalidate because project 3e253dfe684b469383c18ff8c2a3dbd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:13.347261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:13.348395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f6cc4ee-90a8-433a-9395-db895956da42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:13.351720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 967/1978] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:13 2022] DELETE /identity/v3/projects/3e253dfe684b469383c18ff8c2a3dbd9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:13.358803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f90b5-df5e-40b8-81bb-e0a8a9e63d0d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.359100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f90b5-df5e-40b8-81bb-e0a8a9e63d0d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.359780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f90b5-df5e-40b8-81bb-e0a8a9e63d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.382405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-671f90b5-df5e-40b8-81bb-e0a8a9e63d0d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:13.384101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-671f90b5-df5e-40b8-81bb-e0a8a9e63d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:13.454336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1012/1979] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:13.462733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1fab7-ecc9-4da4-b93f-484e1575b5f6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.463160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1fab7-ecc9-4da4-b93f-484e1575b5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.463566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1fab7-ecc9-4da4-b93f-484e1575b5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.486393 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-cdd1fab7-ecc9-4da4-b93f-484e1575b5f6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:13.488724 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cdd1fab7-ecc9-4da4-b93f-484e1575b5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:13.502616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 968/1980] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:13.508238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f90b5-df5e-40b8-81bb-e0a8a9e63d0d None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:13.527210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f90b5-df5e-40b8-81bb-e0a8a9e63d0d None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:13.534656 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f44f79-112b-4eba-9de2-8eb8c9df16f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:13.535549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f44f79-112b-4eba-9de2-8eb8c9df16f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.535966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f44f79-112b-4eba-9de2-8eb8c9df16f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.536386 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f44f79-112b-4eba-9de2-8eb8c9df16f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.537682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f44f79-112b-4eba-9de2-8eb8c9df16f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:13.538140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f44f79-112b-4eba-9de2-8eb8c9df16f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:13.540141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f44f79-112b-4eba-9de2-8eb8c9df16f5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:13.558559 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1013/1981] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:13.561069 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467eb4f9-79b7-404d-b043-c798ad66fae2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.561318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f44f79-112b-4eba-9de2-8eb8c9df16f5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:13.561739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467eb4f9-79b7-404d-b043-c798ad66fae2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.562188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467eb4f9-79b7-404d-b043-c798ad66fae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.572029 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f44f79-112b-4eba-9de2-8eb8c9df16f5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:13.577479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf9ee3-e881-427d-a83e-5e46a01da479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:13.578411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf9ee3-e881-427d-a83e-5e46a01da479 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.578779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf9ee3-e881-427d-a83e-5e46a01da479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.578992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf9ee3-e881-427d-a83e-5e46a01da479 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.579883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf9ee3-e881-427d-a83e-5e46a01da479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:13.581974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf9ee3-e881-427d-a83e-5e46a01da479 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:13.584682 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-467eb4f9-79b7-404d-b043-c798ad66fae2 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:13.585998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-467eb4f9-79b7-404d-b043-c798ad66fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:13.617235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1014/1982] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:13 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:13.621290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf9ee3-e881-427d-a83e-5e46a01da479 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:13.666682 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 969/1983] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 10:22:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:13.680039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467eb4f9-79b7-404d-b043-c798ad66fae2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:13.681572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-467eb4f9-79b7-404d-b043-c798ad66fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:13.695524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf9ee3-e881-427d-a83e-5e46a01da479 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:13.702442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b847b8-59d4-40e0-8cd3-59a57b7de045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:13.703247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b847b8-59d4-40e0-8cd3-59a57b7de045 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.703607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b847b8-59d4-40e0-8cd3-59a57b7de045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.703946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b847b8-59d4-40e0-8cd3-59a57b7de045 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.704790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b847b8-59d4-40e0-8cd3-59a57b7de045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:13.707549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b847b8-59d4-40e0-8cd3-59a57b7de045 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:13.731181 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1015/1984] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:13 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:13.735232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b847b8-59d4-40e0-8cd3-59a57b7de045 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:13.745356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b847b8-59d4-40e0-8cd3-59a57b7de045 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:13.750049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7336717-35d1-4d83-bf76-717ebb25c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:13.750762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7336717-35d1-4d83-bf76-717ebb25c27d admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.751052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7336717-35d1-4d83-bf76-717ebb25c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.751334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7336717-35d1-4d83-bf76-717ebb25c27d admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.752070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7336717-35d1-4d83-bf76-717ebb25c27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:13.753900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7336717-35d1-4d83-bf76-717ebb25c27d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:13.762854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467eb4f9-79b7-404d-b043-c798ad66fae2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:13.764395 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1016/1985] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:13.768309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7336717-35d1-4d83-bf76-717ebb25c27d admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:13.778606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7336717-35d1-4d83-bf76-717ebb25c27d admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:13.784221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0543efd-05b4-4f9d-9920-36ef8f8adba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:13.784935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0543efd-05b4-4f9d-9920-36ef8f8adba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.785215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0543efd-05b4-4f9d-9920-36ef8f8adba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.785519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0543efd-05b4-4f9d-9920-36ef8f8adba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.786249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0543efd-05b4-4f9d-9920-36ef8f8adba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:13.787910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0543efd-05b4-4f9d-9920-36ef8f8adba8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:13.798990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1017/1986] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:13.803413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0543efd-05b4-4f9d-9920-36ef8f8adba8 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:13.812199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:13.813679 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0543efd-05b4-4f9d-9920-36ef8f8adba8 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:13.818981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13994-8d93-4f05-9779-e96875d2360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:13.819972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13994-8d93-4f05-9779-e96875d2360d admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.820292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13994-8d93-4f05-9779-e96875d2360d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.820576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13994-8d93-4f05-9779-e96875d2360d admin admin] PATH_INFO: `/v3/projects/ce917090701b41c88328a663021c5a92/users/acb3b046bb81496a94dbc7239b3100d2/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.826819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d189-451e-462d-8e3c-e460c4929fae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:13.827489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d189-451e-462d-8e3c-e460c4929fae service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.827774 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d189-451e-462d-8e3c-e460c4929fae service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.828051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d189-451e-462d-8e3c-e460c4929fae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.838165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13994-8d93-4f05-9779-e96875d2360d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce917090701b41c88328a663021c5a92, user_id=acb3b046bb81496a94dbc7239b3100d2, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:13.841086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13994-8d93-4f05-9779-e96875d2360d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:13.856621 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1018/1987] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:13 2022] PUT /identity/v3/projects/ce917090701b41c88328a663021c5a92/users/acb3b046bb81496a94dbc7239b3100d2/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:13.868327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65963f1-cbba-4a3c-8c89-0cab1a827c4c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:13.868682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65963f1-cbba-4a3c-8c89-0cab1a827c4c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:13.868945 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65963f1-cbba-4a3c-8c89-0cab1a827c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:13.888279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:13.895080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7d189-451e-462d-8e3c-e460c4929fae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:13.897895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7d189-451e-462d-8e3c-e460c4929fae service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:13.904860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e65963f1-cbba-4a3c-8c89-0cab1a827c4c None None] MFA Rules not processed for user `acb3b046bb81496a94dbc7239b3100d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:13.907052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e65963f1-cbba-4a3c-8c89-0cab1a827c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:13.912222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 970/1988] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:22:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:13.999792 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1019/1989] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:14.006583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d189-451e-462d-8e3c-e460c4929fae service swift] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:14.018243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d189-451e-462d-8e3c-e460c4929fae service swift] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:14.095514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169ada7-c5dd-4e00-8014-0adbcd8408a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:14.097178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169ada7-c5dd-4e00-8014-0adbcd8408a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:14.097178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169ada7-c5dd-4e00-8014-0adbcd8408a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:14.097178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169ada7-c5dd-4e00-8014-0adbcd8408a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:14.098090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169ada7-c5dd-4e00-8014-0adbcd8408a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:14.100585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169ada7-c5dd-4e00-8014-0adbcd8408a7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:14.138684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 971/1990] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:14 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:14.141820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65963f1-cbba-4a3c-8c89-0cab1a827c4c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:14.153215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65963f1-cbba-4a3c-8c89-0cab1a827c4c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:14.217713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987509a3-07f2-498a-b17f-e79e1484522d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:14.218403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987509a3-07f2-498a-b17f-e79e1484522d admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:14.218741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987509a3-07f2-498a-b17f-e79e1484522d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:14.219017 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987509a3-07f2-498a-b17f-e79e1484522d admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:14.219725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987509a3-07f2-498a-b17f-e79e1484522d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:14.224526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987509a3-07f2-498a-b17f-e79e1484522d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:14.248345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1020/1991] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:14 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:14.252438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169ada7-c5dd-4e00-8014-0adbcd8408a7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:14.265186 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169ada7-c5dd-4e00-8014-0adbcd8408a7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:14.270076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbfaec-9664-4a1f-8b79-b981d0279281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:14.270771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbfaec-9664-4a1f-8b79-b981d0279281 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:14.271054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbfaec-9664-4a1f-8b79-b981d0279281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:14.271326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbfaec-9664-4a1f-8b79-b981d0279281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:14.272054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbfaec-9664-4a1f-8b79-b981d0279281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:14.273687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbfaec-9664-4a1f-8b79-b981d0279281 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:14.285955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 972/1992] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:14.290946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987509a3-07f2-498a-b17f-e79e1484522d admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:14.302299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987509a3-07f2-498a-b17f-e79e1484522d admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:14.307770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4be050-dfd9-4d5c-b455-92570f010f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:14.308696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4be050-dfd9-4d5c-b455-92570f010f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:14.308995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4be050-dfd9-4d5c-b455-92570f010f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:14.309261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4be050-dfd9-4d5c-b455-92570f010f05 admin admin] PATH_INFO: `/v3/projects/319de0b6101644faa2968c609ed096fd/users/1530f55a4ddb423bbb458283eeecd2c2/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:14.327111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4be050-dfd9-4d5c-b455-92570f010f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319de0b6101644faa2968c609ed096fd, user_id=1530f55a4ddb423bbb458283eeecd2c2, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:14.329839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4be050-dfd9-4d5c-b455-92570f010f05 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:14.345807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1021/1993] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:14 2022] PUT /identity/v3/projects/319de0b6101644faa2968c609ed096fd/users/1530f55a4ddb423bbb458283eeecd2c2/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:14.350310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbfaec-9664-4a1f-8b79-b981d0279281 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:14.360888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbfaec-9664-4a1f-8b79-b981d0279281 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:14.424570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01146bf-8a3f-4306-9db9-781e96d3d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:14.425281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01146bf-8a3f-4306-9db9-781e96d3d54d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:14.425567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01146bf-8a3f-4306-9db9-781e96d3d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:14.425845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01146bf-8a3f-4306-9db9-781e96d3d54d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:14.426607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01146bf-8a3f-4306-9db9-781e96d3d54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:14.428224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01146bf-8a3f-4306-9db9-781e96d3d54d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:14.438494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 973/1994] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:14.443047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4be050-dfd9-4d5c-b455-92570f010f05 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:14.454050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4be050-dfd9-4d5c-b455-92570f010f05 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:14.458956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb03e71-63b7-45a3-86ed-e386c600cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:14.459858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb03e71-63b7-45a3-86ed-e386c600cfb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:14.460140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb03e71-63b7-45a3-86ed-e386c600cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:14.460420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb03e71-63b7-45a3-86ed-e386c600cfb6 admin admin] PATH_INFO: `/v3/projects/319de0b6101644faa2968c609ed096fd/users/1530f55a4ddb423bbb458283eeecd2c2/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:14.462571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb03e71-63b7-45a3-86ed-e386c600cfb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319de0b6101644faa2968c609ed096fd, user_id=1530f55a4ddb423bbb458283eeecd2c2, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:14.465237 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb03e71-63b7-45a3-86ed-e386c600cfb6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:14.476576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1022/1995] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:14 2022] PUT /identity/v3/projects/319de0b6101644faa2968c609ed096fd/users/1530f55a4ddb423bbb458283eeecd2c2/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:14.488110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fc124-9fd7-4aaf-b77e-b775592d6933 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:14.488439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fc124-9fd7-4aaf-b77e-b775592d6933 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:14.488722 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fc124-9fd7-4aaf-b77e-b775592d6933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:14.495649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:14.517291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b00fc124-9fd7-4aaf-b77e-b775592d6933 None None] MFA Rules not processed for user `1530f55a4ddb423bbb458283eeecd2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:14.518570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b00fc124-9fd7-4aaf-b77e-b775592d6933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:14.596038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 974/1996] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:14.608145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb03e71-63b7-45a3-86ed-e386c600cfb6 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:14.610002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-bbb03e71-63b7-45a3-86ed-e386c600cfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:14.676672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb03e71-63b7-45a3-86ed-e386c600cfb6 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:14.680343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93d9aa-3c88-4cc4-9b5b-7a74102f7448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:14.681039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93d9aa-3c88-4cc4-9b5b-7a74102f7448 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:14.681398 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93d9aa-3c88-4cc4-9b5b-7a74102f7448 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:14.681677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93d9aa-3c88-4cc4-9b5b-7a74102f7448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:14.686435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:14.760172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93d9aa-3c88-4cc4-9b5b-7a74102f7448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:14.761636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93d9aa-3c88-4cc4-9b5b-7a74102f7448 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:14.775072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1023/1997] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:20.325033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fc124-9fd7-4aaf-b77e-b775592d6933 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:20.326779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b00fc124-9fd7-4aaf-b77e-b775592d6933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:20.397700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fc124-9fd7-4aaf-b77e-b775592d6933 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:20.402968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:20.403866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:20.404155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:20.404419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] PATH_INFO: `/v3/users/14092cdf420c419caa3c79434dee6194` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:20.406041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14092cdf420c419caa3c79434dee6194)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:20.408026 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:20.456498 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14092cdf420c419caa3c79434dee6194'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.464170 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14092cdf420c419caa3c79434dee6194'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.464940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14092cdf420c419caa3c79434dee6194'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.477729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14092cdf420c419caa3c79434dee6194'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.484835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14092cdf420c419caa3c79434dee6194'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.491302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 975/1998] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:20 2022] DELETE /identity/v3/users/14092cdf420c419caa3c79434dee6194 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:20.496168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c6119-12aa-4c79-84f3-6a602d83e2f7 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:20.496686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c6119-12aa-4c79-84f3-6a602d83e2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:20.496686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c6119-12aa-4c79-84f3-6a602d83e2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:20.517273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-531c6119-12aa-4c79-84f3-6a602d83e2f7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:20.518543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-531c6119-12aa-4c79-84f3-6a602d83e2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:20.584197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1024/1999] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:20.593324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:20.594888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:20.606370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:20.663074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae06cf-783e-42ae-bb27-6b9775102833 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:20.666870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5c620-9003-4d72-8c79-c9a59a720376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:20.667528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5c620-9003-4d72-8c79-c9a59a720376 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:20.667815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5c620-9003-4d72-8c79-c9a59a720376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:20.668089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5c620-9003-4d72-8c79-c9a59a720376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:20.678098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5c620-9003-4d72-8c79-c9a59a720376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:20.680140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5c620-9003-4d72-8c79-c9a59a720376 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:20.691476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 976/2000] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:20.887009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c6119-12aa-4c79-84f3-6a602d83e2f7 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:20.888895 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-531c6119-12aa-4c79-84f3-6a602d83e2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:20.901523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c6119-12aa-4c79-84f3-6a602d83e2f7 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:20.907366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:20.908365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:20.908685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:20.908982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] PATH_INFO: `/v3/projects/ebe481a378f5454d975d405bc78d1203` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:20.910198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe481a378f5454d975d405bc78d1203)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:20.912201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:20.960774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe481a378f5454d975d405bc78d1203', 'request_id': 'req-db3ef6e4-02a2-4874-9b22-465acd691b5c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.970040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe481a378f5454d975d405bc78d1203', 'request_id': 'req-db3ef6e4-02a2-4874-9b22-465acd691b5c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.977292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe481a378f5454d975d405bc78d1203', 'request_id': 'req-db3ef6e4-02a2-4874-9b22-465acd691b5c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.993468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] The token cache is being invalidate because project ebe481a378f5454d975d405bc78d1203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:20.993958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.995426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-db3ef6e4-02a2-4874-9b22-465acd691b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.998120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1025/2001] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:20 2022] DELETE /identity/v3/projects/ebe481a378f5454d975d405bc78d1203 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:21.005532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3fe58-997f-4dab-ba13-89d498b30c25 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.005777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3fe58-997f-4dab-ba13-89d498b30c25 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.006107 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3fe58-997f-4dab-ba13-89d498b30c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.031452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-36b3fe58-997f-4dab-ba13-89d498b30c25 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:21.032788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-36b3fe58-997f-4dab-ba13-89d498b30c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:21.103353 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 977/2002] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:21.111321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722398f-a7ab-4f5b-8658-4ba715ad48d2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.111606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722398f-a7ab-4f5b-8658-4ba715ad48d2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.111880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722398f-a7ab-4f5b-8658-4ba715ad48d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.136273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-6722398f-a7ab-4f5b-8658-4ba715ad48d2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:21.137395 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-6722398f-a7ab-4f5b-8658-4ba715ad48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:21.145885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1026/2003] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:21.149846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3fe58-997f-4dab-ba13-89d498b30c25 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:21.160463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3fe58-997f-4dab-ba13-89d498b30c25 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:21.165888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036b30d-e2b8-42ce-8c5f-90ae5b096c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:21.166629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036b30d-e2b8-42ce-8c5f-90ae5b096c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.166906 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036b30d-e2b8-42ce-8c5f-90ae5b096c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.167214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036b30d-e2b8-42ce-8c5f-90ae5b096c8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.167935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036b30d-e2b8-42ce-8c5f-90ae5b096c8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:21.168237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036b30d-e2b8-42ce-8c5f-90ae5b096c8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:21.169855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036b30d-e2b8-42ce-8c5f-90ae5b096c8c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:21.184176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 978/2004] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:21.188752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722398f-a7ab-4f5b-8658-4ba715ad48d2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:21.198690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722398f-a7ab-4f5b-8658-4ba715ad48d2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:21.203631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e052-6913-4065-bf8c-c1a39fbfd32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:21.204298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e052-6913-4065-bf8c-c1a39fbfd32c admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.204582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e052-6913-4065-bf8c-c1a39fbfd32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.204871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e052-6913-4065-bf8c-c1a39fbfd32c admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.205559 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65e052-6913-4065-bf8c-c1a39fbfd32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:21.207617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65e052-6913-4065-bf8c-c1a39fbfd32c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:21.228368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:21.237342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1027/2005] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:21 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:21.241482 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036b30d-e2b8-42ce-8c5f-90ae5b096c8c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:21.251907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036b30d-e2b8-42ce-8c5f-90ae5b096c8c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:21.313414 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3df98f-4125-433b-9d75-b5a2f2a2c153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:21.314101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3df98f-4125-433b-9d75-b5a2f2a2c153 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.314381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3df98f-4125-433b-9d75-b5a2f2a2c153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.314700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3df98f-4125-433b-9d75-b5a2f2a2c153 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.315415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3df98f-4125-433b-9d75-b5a2f2a2c153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:21.317372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3df98f-4125-433b-9d75-b5a2f2a2c153 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:21.340192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 979/2006] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:21 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:21.344514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e052-6913-4065-bf8c-c1a39fbfd32c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:21.354913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e052-6913-4065-bf8c-c1a39fbfd32c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:21.359493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd2969-ed0f-4f52-82e3-574421309e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:21.360153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd2969-ed0f-4f52-82e3-574421309e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.360431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd2969-ed0f-4f52-82e3-574421309e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.360701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd2969-ed0f-4f52-82e3-574421309e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.361431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd2969-ed0f-4f52-82e3-574421309e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:21.363090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd2969-ed0f-4f52-82e3-574421309e2f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:21.374159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1028/2007] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:21.378704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3df98f-4125-433b-9d75-b5a2f2a2c153 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:21.390296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3df98f-4125-433b-9d75-b5a2f2a2c153 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:21.395425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60069fea-69f7-459e-96d3-818b6c77b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:21.396129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60069fea-69f7-459e-96d3-818b6c77b4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.396407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60069fea-69f7-459e-96d3-818b6c77b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.396680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60069fea-69f7-459e-96d3-818b6c77b4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.397454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60069fea-69f7-459e-96d3-818b6c77b4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:21.399099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60069fea-69f7-459e-96d3-818b6c77b4a8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:21.411308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 980/2008] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:21.415496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd2969-ed0f-4f52-82e3-574421309e2f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:21.426338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd2969-ed0f-4f52-82e3-574421309e2f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:21.432652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0727d-e78a-4e8d-9cc8-98aefd6fe067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:21.433653 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0727d-e78a-4e8d-9cc8-98aefd6fe067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.433987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0727d-e78a-4e8d-9cc8-98aefd6fe067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.434264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0727d-e78a-4e8d-9cc8-98aefd6fe067 admin admin] PATH_INFO: `/v3/projects/a4a87feacfb84d6c9f7ea48f230753b7/users/a394fc62e6a64a85b855bf2eb56b4b71/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.451654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0727d-e78a-4e8d-9cc8-98aefd6fe067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a87feacfb84d6c9f7ea48f230753b7, user_id=a394fc62e6a64a85b855bf2eb56b4b71, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:21.454357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0727d-e78a-4e8d-9cc8-98aefd6fe067 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:21.469034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1029/2009] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:21 2022] PUT /identity/v3/projects/a4a87feacfb84d6c9f7ea48f230753b7/users/a394fc62e6a64a85b855bf2eb56b4b71/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:21.474402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73971b0-d7d8-46ad-ad11-b3d819c07aaa None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.474725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73971b0-d7d8-46ad-ad11-b3d819c07aaa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.475004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73971b0-d7d8-46ad-ad11-b3d819c07aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.494066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c73971b0-d7d8-46ad-ad11-b3d819c07aaa None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:21.495316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c73971b0-d7d8-46ad-ad11-b3d819c07aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:21.507596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:21.559573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 981/2010] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:21.569649 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0727d-e78a-4e8d-9cc8-98aefd6fe067 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:21.571490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-28d0727d-e78a-4e8d-9cc8-98aefd6fe067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:21.631647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0727d-e78a-4e8d-9cc8-98aefd6fe067 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:21.635593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19878b2-46bc-44f4-a6dc-abfe189ac674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:21.636247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19878b2-46bc-44f4-a6dc-abfe189ac674 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.636513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19878b2-46bc-44f4-a6dc-abfe189ac674 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.636793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19878b2-46bc-44f4-a6dc-abfe189ac674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.646641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19878b2-46bc-44f4-a6dc-abfe189ac674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:21.648106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19878b2-46bc-44f4-a6dc-abfe189ac674 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:21.658186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1030/2011] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:25.699434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b7050-852c-4637-b57e-11d220395070 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.699923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b7050-852c-4637-b57e-11d220395070 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.700184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b7050-852c-4637-b57e-11d220395070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.732832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b02b7050-852c-4637-b57e-11d220395070 None None] MFA Rules not processed for user `a394fc62e6a64a85b855bf2eb56b4b71`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:25.734112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b02b7050-852c-4637-b57e-11d220395070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:25.820301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 982/2012] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:25.824717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19878b2-46bc-44f4-a6dc-abfe189ac674 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.835855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19878b2-46bc-44f4-a6dc-abfe189ac674 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.841526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6236c-8a76-4e44-a139-328a8f313b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.842196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6236c-8a76-4e44-a139-328a8f313b6c admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.842605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6236c-8a76-4e44-a139-328a8f313b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.842879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6236c-8a76-4e44-a139-328a8f313b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.843668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6236c-8a76-4e44-a139-328a8f313b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.846235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6236c-8a76-4e44-a139-328a8f313b6c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:25.879540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1031/2013] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:25 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:25.883968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b7050-852c-4637-b57e-11d220395070 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.896734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b7050-852c-4637-b57e-11d220395070 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.986615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a00337-58fe-4731-8ae7-6c986abd1a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.987563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00337-58fe-4731-8ae7-6c986abd1a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.987840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00337-58fe-4731-8ae7-6c986abd1a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.988109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00337-58fe-4731-8ae7-6c986abd1a31 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.988827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a00337-58fe-4731-8ae7-6c986abd1a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.990788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a00337-58fe-4731-8ae7-6c986abd1a31 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:26.013908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 983/2014] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:25 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:26.017918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6236c-8a76-4e44-a139-328a8f313b6c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:26.029439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6236c-8a76-4e44-a139-328a8f313b6c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:26.036163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28e8e-6ceb-44f2-b7f4-90be3ab2f644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:26.036904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28e8e-6ceb-44f2-b7f4-90be3ab2f644 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:26.037198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28e8e-6ceb-44f2-b7f4-90be3ab2f644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:26.037468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28e8e-6ceb-44f2-b7f4-90be3ab2f644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:26.038231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d28e8e-6ceb-44f2-b7f4-90be3ab2f644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:26.039951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d28e8e-6ceb-44f2-b7f4-90be3ab2f644 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:26.059349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1032/2015] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:26.061125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a00337-58fe-4731-8ae7-6c986abd1a31 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:26.072484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a00337-58fe-4731-8ae7-6c986abd1a31 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:26.084904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff01e4-dbc0-4296-96ac-94b2fc5ee6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:26.085856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff01e4-dbc0-4296-96ac-94b2fc5ee6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:26.086140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff01e4-dbc0-4296-96ac-94b2fc5ee6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:26.086420 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff01e4-dbc0-4296-96ac-94b2fc5ee6d0 admin admin] PATH_INFO: `/v3/projects/fc7af3c9681f48128af2dbee6c4c13c2/users/f2bd9c8578b84a73a47074deafb3e373/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:26.106230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff01e4-dbc0-4296-96ac-94b2fc5ee6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7af3c9681f48128af2dbee6c4c13c2, user_id=f2bd9c8578b84a73a47074deafb3e373, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:26.108963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff01e4-dbc0-4296-96ac-94b2fc5ee6d0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:26.128955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 984/2016] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:26 2022] PUT /identity/v3/projects/fc7af3c9681f48128af2dbee6c4c13c2/users/f2bd9c8578b84a73a47074deafb3e373/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:26.130828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28e8e-6ceb-44f2-b7f4-90be3ab2f644 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:26.141902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28e8e-6ceb-44f2-b7f4-90be3ab2f644 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:26.217306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edf127-fbed-4bc9-b98a-0f1a49a29089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:26.218330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf127-fbed-4bc9-b98a-0f1a49a29089 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:26.218804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf127-fbed-4bc9-b98a-0f1a49a29089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:26.219232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf127-fbed-4bc9-b98a-0f1a49a29089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:26.220158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edf127-fbed-4bc9-b98a-0f1a49a29089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:26.222033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edf127-fbed-4bc9-b98a-0f1a49a29089 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:26.242973 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1033/2017] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:26.247592 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff01e4-dbc0-4296-96ac-94b2fc5ee6d0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:26.258771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff01e4-dbc0-4296-96ac-94b2fc5ee6d0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:26.264651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c0e41-7439-4173-b963-ef439372b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:26.266472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c0e41-7439-4173-b963-ef439372b019 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:26.266472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c0e41-7439-4173-b963-ef439372b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:26.266472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c0e41-7439-4173-b963-ef439372b019 admin admin] PATH_INFO: `/v3/projects/fc7af3c9681f48128af2dbee6c4c13c2/users/f2bd9c8578b84a73a47074deafb3e373/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:26.268692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c0e41-7439-4173-b963-ef439372b019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7af3c9681f48128af2dbee6c4c13c2, user_id=f2bd9c8578b84a73a47074deafb3e373, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:26.271831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c0e41-7439-4173-b963-ef439372b019 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:26.280278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:26.292336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 985/2018] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:26 2022] PUT /identity/v3/projects/fc7af3c9681f48128af2dbee6c4c13c2/users/f2bd9c8578b84a73a47074deafb3e373/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:26.758344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edf127-fbed-4bc9-b98a-0f1a49a29089 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:26.760765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f1edf127-fbed-4bc9-b98a-0f1a49a29089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:26.812607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:26.873244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edf127-fbed-4bc9-b98a-0f1a49a29089 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:27.063975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dd331-813b-4444-ad14-a3bdd1d3a934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:27.065642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd331-813b-4444-ad14-a3bdd1d3a934 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:27.066195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd331-813b-4444-ad14-a3bdd1d3a934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:27.066732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd331-813b-4444-ad14-a3bdd1d3a934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:27.071624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9e1dd331-813b-4444-ad14-a3bdd1d3a934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:27.205731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dd331-813b-4444-ad14-a3bdd1d3a934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:27.208367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dd331-813b-4444-ad14-a3bdd1d3a934 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:27.224997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1034/2019] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:31.578669 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f66d1-cc53-4ee0-ad86-5d0444730554 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:31.579222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f66d1-cc53-4ee0-ad86-5d0444730554 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:31.579321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f66d1-cc53-4ee0-ad86-5d0444730554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:31.611870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e06f66d1-cc53-4ee0-ad86-5d0444730554 None None] MFA Rules not processed for user `f2bd9c8578b84a73a47074deafb3e373`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:31.613116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e06f66d1-cc53-4ee0-ad86-5d0444730554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:31.689093 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 986/2020] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:31.703501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dd331-813b-4444-ad14-a3bdd1d3a934 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:31.705104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9e1dd331-813b-4444-ad14-a3bdd1d3a934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:31.795265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dd331-813b-4444-ad14-a3bdd1d3a934 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:31.802023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06e788-0fdf-484a-820d-1a1a4112cd93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:31.803396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06e788-0fdf-484a-820d-1a1a4112cd93 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:31.803396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06e788-0fdf-484a-820d-1a1a4112cd93 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:31.803601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06e788-0fdf-484a-820d-1a1a4112cd93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:31.841005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:31.871587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06e788-0fdf-484a-820d-1a1a4112cd93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:31.873408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06e788-0fdf-484a-820d-1a1a4112cd93 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:31.883187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1035/2021] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:34.478078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f66d1-cc53-4ee0-ad86-5d0444730554 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:34.483499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e06f66d1-cc53-4ee0-ad86-5d0444730554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:34.575345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f66d1-cc53-4ee0-ad86-5d0444730554 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:34.581544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:34.582445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:34.582760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:34.583039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] PATH_INFO: `/v3/users/15b4b9032c164af895b0b826ad337c02` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:34.584371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b4b9032c164af895b0b826ad337c02)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:34.587113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:34.657710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b4b9032c164af895b0b826ad337c02'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:34.669364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b4b9032c164af895b0b826ad337c02'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:34.670094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b4b9032c164af895b0b826ad337c02'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:34.684915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b4b9032c164af895b0b826ad337c02'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:34.695857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b4b9032c164af895b0b826ad337c02'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:34.707307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 987/2022] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:34 2022] DELETE /identity/v3/users/15b4b9032c164af895b0b826ad337c02 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:34.709004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c92c8a-1bea-4f71-8896-2d1d2a511f56 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:34.709505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c92c8a-1bea-4f71-8896-2d1d2a511f56 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:34.709712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c92c8a-1bea-4f71-8896-2d1d2a511f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:34.728486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-61c92c8a-1bea-4f71-8896-2d1d2a511f56 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:34.729807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-61c92c8a-1bea-4f71-8896-2d1d2a511f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:34.841717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1036/2023] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:34.851816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:34.853577 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:34.870818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:34.962162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3be887-2978-4d3f-bb55-ce7d4ed08bc5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:34.966394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b126e9-deef-4a07-97ea-1d02d5c8629a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:34.967268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b126e9-deef-4a07-97ea-1d02d5c8629a service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:34.967694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b126e9-deef-4a07-97ea-1d02d5c8629a service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:34.968172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b126e9-deef-4a07-97ea-1d02d5c8629a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:34.979763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b126e9-deef-4a07-97ea-1d02d5c8629a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:34.983233 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b126e9-deef-4a07-97ea-1d02d5c8629a service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:35.003412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 988/2024] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:22:35.438063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c92c8a-1bea-4f71-8896-2d1d2a511f56 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:35.440329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-61c92c8a-1bea-4f71-8896-2d1d2a511f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:35.460478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c92c8a-1bea-4f71-8896-2d1d2a511f56 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:35.478039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:35.479354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:35.479354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:35.479557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] PATH_INFO: `/v3/projects/f3aa102899644ccea7b4aae8287458ab` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:35.482412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3aa102899644ccea7b4aae8287458ab)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:35.484433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:35.579700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3aa102899644ccea7b4aae8287458ab', 'request_id': 'req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:35.589508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3aa102899644ccea7b4aae8287458ab', 'request_id': 'req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:35.603601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3aa102899644ccea7b4aae8287458ab', 'request_id': 'req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:35.621855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] The token cache is being invalidate because project f3aa102899644ccea7b4aae8287458ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:35.622139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:35.622877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f47f9ecc-f5d5-42e9-b42e-cfe1c2980bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:35.625005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1037/2025] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:35 2022] DELETE /identity/v3/projects/f3aa102899644ccea7b4aae8287458ab => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:35.630531 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acee68-56a2-4c9c-bb70-1694ec34393c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:35.631085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acee68-56a2-4c9c-bb70-1694ec34393c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:35.631085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acee68-56a2-4c9c-bb70-1694ec34393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:35.655742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-48acee68-56a2-4c9c-bb70-1694ec34393c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:35.656912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-48acee68-56a2-4c9c-bb70-1694ec34393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:35.765165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 989/2026] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:35.767626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcc4c6-eb67-47e4-acbb-cc826e4cd551 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:35.768129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcc4c6-eb67-47e4-acbb-cc826e4cd551 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:35.768471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcc4c6-eb67-47e4-acbb-cc826e4cd551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:35.817024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c3fcc4c6-eb67-47e4-acbb-cc826e4cd551 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:35.821219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c3fcc4c6-eb67-47e4-acbb-cc826e4cd551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:35.835126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1038/2027] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:35.839709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acee68-56a2-4c9c-bb70-1694ec34393c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:35.856221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acee68-56a2-4c9c-bb70-1694ec34393c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:35.863409 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6c567-4984-48af-954e-c02d592b2249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:35.865048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6c567-4984-48af-954e-c02d592b2249 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:35.872019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6c567-4984-48af-954e-c02d592b2249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:35.872019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6c567-4984-48af-954e-c02d592b2249 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:35.872547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6c567-4984-48af-954e-c02d592b2249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:35.875024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6c567-4984-48af-954e-c02d592b2249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:35.876909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6c567-4984-48af-954e-c02d592b2249 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:35.900752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 990/2028] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:35.902571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcc4c6-eb67-47e4-acbb-cc826e4cd551 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:35.925792 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcc4c6-eb67-47e4-acbb-cc826e4cd551 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:35.937359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f5d5d-3be3-4b8c-9ed7-a8676a4b6e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:35.938165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f5d5d-3be3-4b8c-9ed7-a8676a4b6e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:35.938583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f5d5d-3be3-4b8c-9ed7-a8676a4b6e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:35.938972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f5d5d-3be3-4b8c-9ed7-a8676a4b6e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:35.940094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f5d5d-3be3-4b8c-9ed7-a8676a4b6e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:35.942424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f5d5d-3be3-4b8c-9ed7-a8676a4b6e89 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:35.988854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1039/2029] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:35 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:35.990145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6c567-4984-48af-954e-c02d592b2249 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.006194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6c567-4984-48af-954e-c02d592b2249 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:36.102489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb2fb-fda4-41e7-a302-b8abf86214b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:36.103342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb2fb-fda4-41e7-a302-b8abf86214b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.104099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb2fb-fda4-41e7-a302-b8abf86214b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.109240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb2fb-fda4-41e7-a302-b8abf86214b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.110148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdeb2fb-fda4-41e7-a302-b8abf86214b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:36.117588 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdeb2fb-fda4-41e7-a302-b8abf86214b6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:36.142854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f5d5d-3be3-4b8c-9ed7-a8676a4b6e89 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.143608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 991/2030] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:35 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:36.155170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f5d5d-3be3-4b8c-9ed7-a8676a4b6e89 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:36.161194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392e3b0-19a3-4c97-8901-78e3674912bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:36.161894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e3b0-19a3-4c97-8901-78e3674912bc admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.162181 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e3b0-19a3-4c97-8901-78e3674912bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.162458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e3b0-19a3-4c97-8901-78e3674912bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.163253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392e3b0-19a3-4c97-8901-78e3674912bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:36.164976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392e3b0-19a3-4c97-8901-78e3674912bc admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:36.176680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1040/2031] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:36.181587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb2fb-fda4-41e7-a302-b8abf86214b6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.197611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb2fb-fda4-41e7-a302-b8abf86214b6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:36.205096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f42580-f005-43a4-a1c7-faf7b118600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:36.205816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f42580-f005-43a4-a1c7-faf7b118600f admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.206094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f42580-f005-43a4-a1c7-faf7b118600f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.206371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f42580-f005-43a4-a1c7-faf7b118600f admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.207139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f42580-f005-43a4-a1c7-faf7b118600f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:36.208749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f42580-f005-43a4-a1c7-faf7b118600f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:36.223241 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 992/2032] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:36.224884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392e3b0-19a3-4c97-8901-78e3674912bc admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.237322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392e3b0-19a3-4c97-8901-78e3674912bc admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:36.242219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1b89d-fcb7-48ae-8510-97b97a895fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:36.243288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b89d-fcb7-48ae-8510-97b97a895fac admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.243564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b89d-fcb7-48ae-8510-97b97a895fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.243843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b89d-fcb7-48ae-8510-97b97a895fac admin admin] PATH_INFO: `/v3/projects/e47e4b1b6d934a7fab361070d779eeb5/users/6769ef4345594a7b9f7fdf22103095d1/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.260640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1b89d-fcb7-48ae-8510-97b97a895fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47e4b1b6d934a7fab361070d779eeb5, user_id=6769ef4345594a7b9f7fdf22103095d1, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:36.263436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1b89d-fcb7-48ae-8510-97b97a895fac admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:36.265999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:36.281744 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1041/2033] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:36 2022] PUT /identity/v3/projects/e47e4b1b6d934a7fab361070d779eeb5/users/6769ef4345594a7b9f7fdf22103095d1/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:36.292525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122e98-4505-4662-ba18-e1f8d7339e2c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.292796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122e98-4505-4662-ba18-e1f8d7339e2c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.293095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122e98-4505-4662-ba18-e1f8d7339e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.321239 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:36.325182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-53122e98-4505-4662-ba18-e1f8d7339e2c None None] MFA Rules not processed for user `6769ef4345594a7b9f7fdf22103095d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:36.327575 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-53122e98-4505-4662-ba18-e1f8d7339e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:36.425270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 993/2034] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:36.438629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1b89d-fcb7-48ae-8510-97b97a895fac admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.440617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8fe1b89d-fcb7-48ae-8510-97b97a895fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:36.502199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1b89d-fcb7-48ae-8510-97b97a895fac admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:36.506295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527ba1d-05d3-4694-afdc-02c2dd01b482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:36.506999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ba1d-05d3-4694-afdc-02c2dd01b482 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.507282 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ba1d-05d3-4694-afdc-02c2dd01b482 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.507562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ba1d-05d3-4694-afdc-02c2dd01b482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.517317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527ba1d-05d3-4694-afdc-02c2dd01b482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:36.518868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527ba1d-05d3-4694-afdc-02c2dd01b482 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:36.531634 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1042/2035] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:36.561560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122e98-4505-4662-ba18-e1f8d7339e2c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.624257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122e98-4505-4662-ba18-e1f8d7339e2c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:36.629157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:36.630056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.630338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.630646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] PATH_INFO: `/v3/users/6769ef4345594a7b9f7fdf22103095d1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.632017 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6769ef4345594a7b9f7fdf22103095d1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:36.633975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:36.685349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6769ef4345594a7b9f7fdf22103095d1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:36.692608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6769ef4345594a7b9f7fdf22103095d1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:36.693381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6769ef4345594a7b9f7fdf22103095d1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:36.705792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6769ef4345594a7b9f7fdf22103095d1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:36.712882 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6769ef4345594a7b9f7fdf22103095d1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:36.720192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 994/2036] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:36 2022] DELETE /identity/v3/users/6769ef4345594a7b9f7fdf22103095d1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:36.725032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148657bc-f940-44f6-ae9b-2dc2936fd761 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.725324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148657bc-f940-44f6-ae9b-2dc2936fd761 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.725601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148657bc-f940-44f6-ae9b-2dc2936fd761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.744720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-148657bc-f940-44f6-ae9b-2dc2936fd761 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:36.745966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-148657bc-f940-44f6-ae9b-2dc2936fd761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:36.814166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1043/2037] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:36.826406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.828018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:36.885043 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:36.945099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673f42c-31f3-457a-acea-e047f55ec074 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:36.949581 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5069e5f-1a73-4c13-a4db-5fea500dd702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:36.950270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069e5f-1a73-4c13-a4db-5fea500dd702 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.950587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069e5f-1a73-4c13-a4db-5fea500dd702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.950869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069e5f-1a73-4c13-a4db-5fea500dd702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.961841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5069e5f-1a73-4c13-a4db-5fea500dd702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:36.963900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5069e5f-1a73-4c13-a4db-5fea500dd702 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:36.982939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 995/2038] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:37.286993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148657bc-f940-44f6-ae9b-2dc2936fd761 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:37.288853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-148657bc-f940-44f6-ae9b-2dc2936fd761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:37.305002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148657bc-f940-44f6-ae9b-2dc2936fd761 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:37.318954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:37.319991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.320362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.320740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] PATH_INFO: `/v3/projects/e47e4b1b6d934a7fab361070d779eeb5` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.322162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47e4b1b6d934a7fab361070d779eeb5)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:37.324195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:37.377047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47e4b1b6d934a7fab361070d779eeb5', 'request_id': 'req-65795e3e-4dac-43d4-906e-b631fb6bf213'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.385704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47e4b1b6d934a7fab361070d779eeb5', 'request_id': 'req-65795e3e-4dac-43d4-906e-b631fb6bf213'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.395593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47e4b1b6d934a7fab361070d779eeb5', 'request_id': 'req-65795e3e-4dac-43d4-906e-b631fb6bf213'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.407855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] The token cache is being invalidate because project e47e4b1b6d934a7fab361070d779eeb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:37.408136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.408784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.410368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1044/2039] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:37 2022] DELETE /identity/v3/projects/e47e4b1b6d934a7fab361070d779eeb5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:45.705086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40658a0a-2c46-4ccf-8f73-da56da35fbee None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:45.705660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40658a0a-2c46-4ccf-8f73-da56da35fbee None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:45.705979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40658a0a-2c46-4ccf-8f73-da56da35fbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:45.724914 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-40658a0a-2c46-4ccf-8f73-da56da35fbee None None] MFA Rules not processed for user `0d1dcf4b8dbb4e1698e7b0c4dc9c63a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:45.726122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-40658a0a-2c46-4ccf-8f73-da56da35fbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:45.788463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 996/2040] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:22:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:47.404506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:INSERT=2,keystone:SELECT=82,keystone:DELETE=7 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:55.780848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=41 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:09.387223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:09.388845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:09.523350 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65795e3e-4dac-43d4-906e-b631fb6bf213 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:09.528678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:09.529569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:09.529855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:09.530446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] PATH_INFO: `/v3/users/acb3b046bb81496a94dbc7239b3100d2` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:09.531721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb3b046bb81496a94dbc7239b3100d2)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:09.533698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:09.590847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb3b046bb81496a94dbc7239b3100d2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:09.591135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb3b046bb81496a94dbc7239b3100d2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:09.591864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb3b046bb81496a94dbc7239b3100d2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:09.610858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb3b046bb81496a94dbc7239b3100d2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:09.629606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb3b046bb81496a94dbc7239b3100d2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:09.655668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1045/2041] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:09 2022] DELETE /identity/v3/users/acb3b046bb81496a94dbc7239b3100d2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:09.659962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7866c5-7eec-4bbd-ae0f-91e7c2404f42 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:09.660442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7866c5-7eec-4bbd-ae0f-91e7c2404f42 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:09.660556 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7866c5-7eec-4bbd-ae0f-91e7c2404f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:09.691437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-af7866c5-7eec-4bbd-ae0f-91e7c2404f42 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:09.692390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-af7866c5-7eec-4bbd-ae0f-91e7c2404f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:09.764774 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 997/2042] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:09.774874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:09.776270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:09.799892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:09.880629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af2f18-74f9-457a-93dd-a9bdbc8d4121 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:09.884794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cbf78-6b32-46a2-b969-7b14ef4f934f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:09.885418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cbf78-6b32-46a2-b969-7b14ef4f934f service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:09.885699 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cbf78-6b32-46a2-b969-7b14ef4f934f service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:09.885993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cbf78-6b32-46a2-b969-7b14ef4f934f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:09.895618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cbf78-6b32-46a2-b969-7b14ef4f934f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:09.897064 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cbf78-6b32-46a2-b969-7b14ef4f934f service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:09.907084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1046/2043] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:10.254000 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7866c5-7eec-4bbd-ae0f-91e7c2404f42 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:10.255503 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-af7866c5-7eec-4bbd-ae0f-91e7c2404f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:10.271945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7866c5-7eec-4bbd-ae0f-91e7c2404f42 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:10.277816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:10.278749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.279030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.279295 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] PATH_INFO: `/v3/projects/ce917090701b41c88328a663021c5a92` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.280983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce917090701b41c88328a663021c5a92)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:10.283047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:10.332729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce917090701b41c88328a663021c5a92', 'request_id': 'req-e013b75b-d348-40b9-a05a-991e4b315c9d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.339310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce917090701b41c88328a663021c5a92', 'request_id': 'req-e013b75b-d348-40b9-a05a-991e4b315c9d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.348008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce917090701b41c88328a663021c5a92', 'request_id': 'req-e013b75b-d348-40b9-a05a-991e4b315c9d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.361679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] The token cache is being invalidate because project ce917090701b41c88328a663021c5a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:10.361959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.362656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.364258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 998/2044] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:10 2022] DELETE /identity/v3/projects/ce917090701b41c88328a663021c5a92 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:10.368558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cbf78-6b32-46a2-b969-7b14ef4f934f service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:10.378694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cbf78-6b32-46a2-b969-7b14ef4f934f service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:10.438745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:10.439667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.439944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.440309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] PATH_INFO: `/v3/users/1530f55a4ddb423bbb458283eeecd2c2` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.441840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1530f55a4ddb423bbb458283eeecd2c2)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:10.443811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:10.490288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1530f55a4ddb423bbb458283eeecd2c2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.490976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1530f55a4ddb423bbb458283eeecd2c2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.491599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1530f55a4ddb423bbb458283eeecd2c2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.504229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1530f55a4ddb423bbb458283eeecd2c2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.517575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e5a73e48-914f-42a9-a5f4-bc23b5ccdc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1530f55a4ddb423bbb458283eeecd2c2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.530734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1047/2045] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:10 2022] DELETE /identity/v3/users/1530f55a4ddb423bbb458283eeecd2c2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:11.106150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.107917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.124639 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013b75b-d348-40b9-a05a-991e4b315c9d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.202729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.203621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.203901 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.204176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] PATH_INFO: `/v3/projects/319de0b6101644faa2968c609ed096fd` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.205417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=319de0b6101644faa2968c609ed096fd)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.208547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.230744 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:11.260668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319de0b6101644faa2968c609ed096fd', 'request_id': 'req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.268958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319de0b6101644faa2968c609ed096fd', 'request_id': 'req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.281529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319de0b6101644faa2968c609ed096fd', 'request_id': 'req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.297496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] The token cache is being invalidate because project 319de0b6101644faa2968c609ed096fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:11.298063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.299215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbb9b399-5c63-4f8c-ae01-a5e23b3f4b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.301081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 999/2046] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:11 2022] DELETE /identity/v3/projects/319de0b6101644faa2968c609ed096fd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:11.306770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49a2bb-82a8-4bc3-bd89-7f7f4e3cb59c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.307060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49a2bb-82a8-4bc3-bd89-7f7f4e3cb59c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.307338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49a2bb-82a8-4bc3-bd89-7f7f4e3cb59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.311921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:11.370374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0a49a2bb-82a8-4bc3-bd89-7f7f4e3cb59c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:11.371760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0a49a2bb-82a8-4bc3-bd89-7f7f4e3cb59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.447143 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1048/2047] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:11.455998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f391c86-356f-4a75-9111-aefdbb61c4a5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.456277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f391c86-356f-4a75-9111-aefdbb61c4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.456567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f391c86-356f-4a75-9111-aefdbb61c4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.476067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7f391c86-356f-4a75-9111-aefdbb61c4a5 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:11.477361 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7f391c86-356f-4a75-9111-aefdbb61c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.485974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1000/2048] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:11.490428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49a2bb-82a8-4bc3-bd89-7f7f4e3cb59c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.500550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49a2bb-82a8-4bc3-bd89-7f7f4e3cb59c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.505642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1caad3-9f6a-411b-b4a6-57144f4667f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.506305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1caad3-9f6a-411b-b4a6-57144f4667f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.506623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1caad3-9f6a-411b-b4a6-57144f4667f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.506895 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1caad3-9f6a-411b-b4a6-57144f4667f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.507693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1caad3-9f6a-411b-b4a6-57144f4667f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:11.508018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1caad3-9f6a-411b-b4a6-57144f4667f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.509646 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1caad3-9f6a-411b-b4a6-57144f4667f9 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.521668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1049/2049] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:23:11.526023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f391c86-356f-4a75-9111-aefdbb61c4a5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.536268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f391c86-356f-4a75-9111-aefdbb61c4a5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.542010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf150da7-e184-4524-bc74-ecee3990109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.542692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf150da7-e184-4524-bc74-ecee3990109b admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.542976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf150da7-e184-4524-bc74-ecee3990109b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.543251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf150da7-e184-4524-bc74-ecee3990109b admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.543957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf150da7-e184-4524-bc74-ecee3990109b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.545891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf150da7-e184-4524-bc74-ecee3990109b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.575184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1001/2050] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:11.579523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1caad3-9f6a-411b-b4a6-57144f4667f9 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.590414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1caad3-9f6a-411b-b4a6-57144f4667f9 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.650819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa9bdf-a1e6-49f7-8297-30c69aa83197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.651539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9bdf-a1e6-49f7-8297-30c69aa83197 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.651828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9bdf-a1e6-49f7-8297-30c69aa83197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.652127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9bdf-a1e6-49f7-8297-30c69aa83197 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.652837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa9bdf-a1e6-49f7-8297-30c69aa83197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.654841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa9bdf-a1e6-49f7-8297-30c69aa83197 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.674959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1050/2051] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:11.679154 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf150da7-e184-4524-bc74-ecee3990109b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.690148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf150da7-e184-4524-bc74-ecee3990109b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.696212 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538093b4-713c-454a-a930-74bc96d8d469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.696894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538093b4-713c-454a-a930-74bc96d8d469 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.697178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538093b4-713c-454a-a930-74bc96d8d469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.697449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538093b4-713c-454a-a930-74bc96d8d469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.698168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538093b4-713c-454a-a930-74bc96d8d469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.699860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538093b4-713c-454a-a930-74bc96d8d469 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.711380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1002/2052] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:11.715579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa9bdf-a1e6-49f7-8297-30c69aa83197 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.726433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa9bdf-a1e6-49f7-8297-30c69aa83197 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.739045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ff15-1b1e-49fa-9ee2-33a3d604c73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.740080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ff15-1b1e-49fa-9ee2-33a3d604c73c admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.740425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ff15-1b1e-49fa-9ee2-33a3d604c73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.740825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ff15-1b1e-49fa-9ee2-33a3d604c73c admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.741903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ff15-1b1e-49fa-9ee2-33a3d604c73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.743948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ff15-1b1e-49fa-9ee2-33a3d604c73c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.755274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1051/2053] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:11.761400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538093b4-713c-454a-a930-74bc96d8d469 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.774675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538093b4-713c-454a-a930-74bc96d8d469 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.782715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eba045-5561-4d2e-a64e-ff4fbf2d5bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.783119 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eba045-5561-4d2e-a64e-ff4fbf2d5bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.783404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eba045-5561-4d2e-a64e-ff4fbf2d5bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.783684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eba045-5561-4d2e-a64e-ff4fbf2d5bfe admin admin] PATH_INFO: `/v3/projects/9ba207d53b6a4e70983cd09060756885/users/57e5662e95e343889f461bc3faf49d95/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.803048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eba045-5561-4d2e-a64e-ff4fbf2d5bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba207d53b6a4e70983cd09060756885, user_id=57e5662e95e343889f461bc3faf49d95, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.805881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eba045-5561-4d2e-a64e-ff4fbf2d5bfe admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.822540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1003/2054] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:11 2022] PUT /identity/v3/projects/9ba207d53b6a4e70983cd09060756885/users/57e5662e95e343889f461bc3faf49d95/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:11.833005 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c91c9-9fbd-4523-afa5-77b6428929ba None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.833301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c91c9-9fbd-4523-afa5-77b6428929ba None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.833560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c91c9-9fbd-4523-afa5-77b6428929ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.869050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0f0c91c9-9fbd-4523-afa5-77b6428929ba None None] MFA Rules not processed for user `57e5662e95e343889f461bc3faf49d95`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:11.870398 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0f0c91c9-9fbd-4523-afa5-77b6428929ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.873510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e5284-5ddf-4acb-8ca6-70d2b29b5876 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.873802 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e5284-5ddf-4acb-8ca6-70d2b29b5876 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.874078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e5284-5ddf-4acb-8ca6-70d2b29b5876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.891947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3e6e5284-5ddf-4acb-8ca6-70d2b29b5876 None None] MFA Rules not processed for user `a394fc62e6a64a85b855bf2eb56b4b71`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:11.893173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3e6e5284-5ddf-4acb-8ca6-70d2b29b5876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.904423 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:11.940998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1052/2055] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:11.945633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c91c9-9fbd-4523-afa5-77b6428929ba None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.953723 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1004/2056] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:12.011446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c91c9-9fbd-4523-afa5-77b6428929ba None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.016185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb889534-822e-4c3d-a81d-cfab56071420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.016928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889534-822e-4c3d-a81d-cfab56071420 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.017213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889534-822e-4c3d-a81d-cfab56071420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.017489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889534-822e-4c3d-a81d-cfab56071420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.018190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb889534-822e-4c3d-a81d-cfab56071420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.020174 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb889534-822e-4c3d-a81d-cfab56071420 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.046560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1053/2057] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:12.050937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e5284-5ddf-4acb-8ca6-70d2b29b5876 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.061997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e5284-5ddf-4acb-8ca6-70d2b29b5876 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.126567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:12.143538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6deaf-ba79-4308-98f7-73857279334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.144395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6deaf-ba79-4308-98f7-73857279334c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.144653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6deaf-ba79-4308-98f7-73857279334c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.144954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6deaf-ba79-4308-98f7-73857279334c admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.145687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6deaf-ba79-4308-98f7-73857279334c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.147775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6deaf-ba79-4308-98f7-73857279334c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.174462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1005/2058] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:12 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:12.175749 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb889534-822e-4c3d-a81d-cfab56071420 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.186592 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb889534-822e-4c3d-a81d-cfab56071420 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.191236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805327c-b068-450e-acc0-575a74a66751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.191940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805327c-b068-450e-acc0-575a74a66751 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.192223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805327c-b068-450e-acc0-575a74a66751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.192522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805327c-b068-450e-acc0-575a74a66751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.193237 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805327c-b068-450e-acc0-575a74a66751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.194888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805327c-b068-450e-acc0-575a74a66751 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.209985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1054/2059] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:12.211908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6deaf-ba79-4308-98f7-73857279334c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.223326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6deaf-ba79-4308-98f7-73857279334c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.229192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb4860-197d-4fe5-9a32-c2931a4a4f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.229872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4860-197d-4fe5-9a32-c2931a4a4f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.230153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4860-197d-4fe5-9a32-c2931a4a4f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.230420 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4860-197d-4fe5-9a32-c2931a4a4f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.231212 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb4860-197d-4fe5-9a32-c2931a4a4f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.232856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb4860-197d-4fe5-9a32-c2931a4a4f92 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.244284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1006/2060] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:12.248755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805327c-b068-450e-acc0-575a74a66751 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.259632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805327c-b068-450e-acc0-575a74a66751 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.264904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ee29e-9e91-4611-b35f-b629801cd1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.266012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee29e-9e91-4611-b35f-b629801cd1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.266607 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee29e-9e91-4611-b35f-b629801cd1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.266941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee29e-9e91-4611-b35f-b629801cd1d8 admin admin] PATH_INFO: `/v3/projects/4e9839d3382b459ca1a5ca84acb4d389/users/334490ad120747839c2e7fe519f74337/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.283888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ee29e-9e91-4611-b35f-b629801cd1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9839d3382b459ca1a5ca84acb4d389, user_id=334490ad120747839c2e7fe519f74337, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.286605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ee29e-9e91-4611-b35f-b629801cd1d8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.302163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1055/2061] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:12 2022] PUT /identity/v3/projects/4e9839d3382b459ca1a5ca84acb4d389/users/334490ad120747839c2e7fe519f74337/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:12.313293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682e979-442f-45d5-9fd5-783151cb6442 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.313672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682e979-442f-45d5-9fd5-783151cb6442 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.314003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682e979-442f-45d5-9fd5-783151cb6442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.346545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6682e979-442f-45d5-9fd5-783151cb6442 None None] MFA Rules not processed for user `334490ad120747839c2e7fe519f74337`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:12.347884 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6682e979-442f-45d5-9fd5-783151cb6442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:12.418375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1007/2062] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:12.423017 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ee29e-9e91-4611-b35f-b629801cd1d8 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.492644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ee29e-9e91-4611-b35f-b629801cd1d8 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.499807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8abcc6-d377-4bb7-acc5-bcb772de6ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.500734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8abcc6-d377-4bb7-acc5-bcb772de6ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.501190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8abcc6-d377-4bb7-acc5-bcb772de6ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.501548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8abcc6-d377-4bb7-acc5-bcb772de6ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.502294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8abcc6-d377-4bb7-acc5-bcb772de6ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.504369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8abcc6-d377-4bb7-acc5-bcb772de6ecf admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.535047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1056/2063] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:12 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:12.536413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682e979-442f-45d5-9fd5-783151cb6442 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.548198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682e979-442f-45d5-9fd5-783151cb6442 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.614522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9fce-c5a1-4fe3-8334-3a3ba15555cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.615492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9fce-c5a1-4fe3-8334-3a3ba15555cb admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.615492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9fce-c5a1-4fe3-8334-3a3ba15555cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.615811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9fce-c5a1-4fe3-8334-3a3ba15555cb admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.616457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9fce-c5a1-4fe3-8334-3a3ba15555cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.618655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9fce-c5a1-4fe3-8334-3a3ba15555cb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.641354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1008/2064] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:12 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:12.645540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8abcc6-d377-4bb7-acc5-bcb772de6ecf admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.657636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8abcc6-d377-4bb7-acc5-bcb772de6ecf admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.663192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a9c2-73f4-4730-979e-a2b1b06c71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.663997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a9c2-73f4-4730-979e-a2b1b06c71db admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.664335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a9c2-73f4-4730-979e-a2b1b06c71db admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.664694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a9c2-73f4-4730-979e-a2b1b06c71db admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.665552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a9c2-73f4-4730-979e-a2b1b06c71db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.667366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a9c2-73f4-4730-979e-a2b1b06c71db admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.675387 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:12.682238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1057/2065] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:12.686891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9fce-c5a1-4fe3-8334-3a3ba15555cb admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.697671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9fce-c5a1-4fe3-8334-3a3ba15555cb admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.702717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9506e-f2a2-482e-945d-1764a5bc69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.703630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9506e-f2a2-482e-945d-1764a5bc69e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.703910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9506e-f2a2-482e-945d-1764a5bc69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.704188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9506e-f2a2-482e-945d-1764a5bc69e9 admin admin] PATH_INFO: `/v3/projects/132fbb93d3fa411cb05d8b649f90e95f/users/d96b91ab82414f4fb01e23384bde88ba/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.720445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9506e-f2a2-482e-945d-1764a5bc69e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132fbb93d3fa411cb05d8b649f90e95f, user_id=d96b91ab82414f4fb01e23384bde88ba, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.723508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9506e-f2a2-482e-945d-1764a5bc69e9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.738368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1009/2066] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:12 2022] PUT /identity/v3/projects/132fbb93d3fa411cb05d8b649f90e95f/users/d96b91ab82414f4fb01e23384bde88ba/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:12.742706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a9c2-73f4-4730-979e-a2b1b06c71db admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.753482 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a9c2-73f4-4730-979e-a2b1b06c71db admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.825405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb6330-6e3d-4039-b876-6ded433c9dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.826132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb6330-6e3d-4039-b876-6ded433c9dfc admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.826422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb6330-6e3d-4039-b876-6ded433c9dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.826748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb6330-6e3d-4039-b876-6ded433c9dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.827502 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb6330-6e3d-4039-b876-6ded433c9dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.829135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb6330-6e3d-4039-b876-6ded433c9dfc admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.845592 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1058/2067] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:12.847097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9506e-f2a2-482e-945d-1764a5bc69e9 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.859452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9506e-f2a2-482e-945d-1764a5bc69e9 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.865335 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079e7df-242b-40f4-9a6a-87e65596db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.866240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079e7df-242b-40f4-9a6a-87e65596db35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.866549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079e7df-242b-40f4-9a6a-87e65596db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.867085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079e7df-242b-40f4-9a6a-87e65596db35 admin admin] PATH_INFO: `/v3/projects/132fbb93d3fa411cb05d8b649f90e95f/users/d96b91ab82414f4fb01e23384bde88ba/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.869432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079e7df-242b-40f4-9a6a-87e65596db35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132fbb93d3fa411cb05d8b649f90e95f, user_id=d96b91ab82414f4fb01e23384bde88ba, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.872191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079e7df-242b-40f4-9a6a-87e65596db35 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.895079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1010/2068] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:12 2022] PUT /identity/v3/projects/132fbb93d3fa411cb05d8b649f90e95f/users/d96b91ab82414f4fb01e23384bde88ba/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:12.896797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e52a9-53d1-4ca2-8ee6-91952045a295 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.897088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e52a9-53d1-4ca2-8ee6-91952045a295 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.897368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e52a9-53d1-4ca2-8ee6-91952045a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.942964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e57e52a9-53d1-4ca2-8ee6-91952045a295 None None] MFA Rules not processed for user `d96b91ab82414f4fb01e23384bde88ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:12.944579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e57e52a9-53d1-4ca2-8ee6-91952045a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.024692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1059/2069] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:13.037085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079e7df-242b-40f4-9a6a-87e65596db35 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.039300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1079e7df-242b-40f4-9a6a-87e65596db35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.051740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:13.104333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079e7df-242b-40f4-9a6a-87e65596db35 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.107857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b9c6c-7103-4649-8fed-85b293238d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.108522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b9c6c-7103-4649-8fed-85b293238d3b service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.108807 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b9c6c-7103-4649-8fed-85b293238d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.109085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b9c6c-7103-4649-8fed-85b293238d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.118625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b9c6c-7103-4649-8fed-85b293238d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.120099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b9c6c-7103-4649-8fed-85b293238d3b service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.130166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1011/2070] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:13.173814 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e52a9-53d1-4ca2-8ee6-91952045a295 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.175344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e57e52a9-53d1-4ca2-8ee6-91952045a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.188369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e52a9-53d1-4ca2-8ee6-91952045a295 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.192110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24d58-5425-48ce-8ac7-98d47e887852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.192770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24d58-5425-48ce-8ac7-98d47e887852 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.193056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24d58-5425-48ce-8ac7-98d47e887852 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.193334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24d58-5425-48ce-8ac7-98d47e887852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.268819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24d58-5425-48ce-8ac7-98d47e887852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.270387 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24d58-5425-48ce-8ac7-98d47e887852 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.282210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1060/2071] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:23:16.399662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b9c6c-7103-4649-8fed-85b293238d3b service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:16.465861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b9c6c-7103-4649-8fed-85b293238d3b service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:16.470962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:16.472038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:16.472403 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:16.472767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] PATH_INFO: `/v3/users/57e5662e95e343889f461bc3faf49d95` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:16.474143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e5662e95e343889f461bc3faf49d95)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:16.476167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:16.535304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e5662e95e343889f461bc3faf49d95'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:16.544829 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e5662e95e343889f461bc3faf49d95'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:16.545693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e5662e95e343889f461bc3faf49d95'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:16.565103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e5662e95e343889f461bc3faf49d95'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:16.573751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e5662e95e343889f461bc3faf49d95'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:16.580514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1012/2072] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:16 2022] DELETE /identity/v3/users/57e5662e95e343889f461bc3faf49d95 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:16.586916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49344c-6b33-4b21-ac32-b24a13a55c46 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:16.587442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49344c-6b33-4b21-ac32-b24a13a55c46 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:16.587442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49344c-6b33-4b21-ac32-b24a13a55c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:16.605595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-1e49344c-6b33-4b21-ac32-b24a13a55c46 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:16.607052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1e49344c-6b33-4b21-ac32-b24a13a55c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:16.621106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:16.676913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1061/2073] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:16.687252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:16.688771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:16.733101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:16.759970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84436f24-a4ae-43e2-9e9e-2eb0a573a136 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:16.766364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63463154-8edf-4256-8fd3-0f0d4307e0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:16.767247 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63463154-8edf-4256-8fd3-0f0d4307e0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:16.767518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63463154-8edf-4256-8fd3-0f0d4307e0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:16.767899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63463154-8edf-4256-8fd3-0f0d4307e0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:16.781210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63463154-8edf-4256-8fd3-0f0d4307e0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:16.783062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63463154-8edf-4256-8fd3-0f0d4307e0e5 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:16.794874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1013/2074] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:17.251574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49344c-6b33-4b21-ac32-b24a13a55c46 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:17.253262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1e49344c-6b33-4b21-ac32-b24a13a55c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:17.267708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49344c-6b33-4b21-ac32-b24a13a55c46 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:17.273270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:17.274323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:17.274711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:17.275066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] PATH_INFO: `/v3/projects/9ba207d53b6a4e70983cd09060756885` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:17.276416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba207d53b6a4e70983cd09060756885)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:17.278432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:17.354807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba207d53b6a4e70983cd09060756885', 'request_id': 'req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:17.371446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba207d53b6a4e70983cd09060756885', 'request_id': 'req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:17.386975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba207d53b6a4e70983cd09060756885', 'request_id': 'req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:17.409023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] The token cache is being invalidate because project 9ba207d53b6a4e70983cd09060756885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:17.409504 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:17.410610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:17.413157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1062/2075] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:17 2022] DELETE /identity/v3/projects/9ba207d53b6a4e70983cd09060756885 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:17.418122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63463154-8edf-4256-8fd3-0f0d4307e0e5 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:17.439898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63463154-8edf-4256-8fd3-0f0d4307e0e5 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:17.532733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:17.534603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:17.535139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:17.535790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] PATH_INFO: `/v3/users/334490ad120747839c2e7fe519f74337` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:17.538172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] RBAC: Authorizing `identity:delete_user(user_id=334490ad120747839c2e7fe519f74337)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:17.541566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:17.626898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334490ad120747839c2e7fe519f74337'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:17.637840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334490ad120747839c2e7fe519f74337'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:17.638618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334490ad120747839c2e7fe519f74337'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:17.657748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334490ad120747839c2e7fe519f74337'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:17.670345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334490ad120747839c2e7fe519f74337'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:17.679415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1014/2076] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:17 2022] DELETE /identity/v3/users/334490ad120747839c2e7fe519f74337 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:18.223439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:18.225066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:18.240135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4ee74-5353-4cc3-a575-ea5e82832c5e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:18.305747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:18.306877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:18.307161 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:18.307436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] PATH_INFO: `/v3/projects/4e9839d3382b459ca1a5ca84acb4d389` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:18.308725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9839d3382b459ca1a5ca84acb4d389)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:18.310722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:18.363505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:18.368975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9839d3382b459ca1a5ca84acb4d389', 'request_id': 'req-e227b551-5a71-4238-ad2f-49cc48ad2689'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:18.383532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9839d3382b459ca1a5ca84acb4d389', 'request_id': 'req-e227b551-5a71-4238-ad2f-49cc48ad2689'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:18.392673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9839d3382b459ca1a5ca84acb4d389', 'request_id': 'req-e227b551-5a71-4238-ad2f-49cc48ad2689'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:18.407910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] The token cache is being invalidate because project 4e9839d3382b459ca1a5ca84acb4d389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:18.408220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:18.408905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:18.410688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1063/2077] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:18 2022] DELETE /identity/v3/projects/4e9839d3382b459ca1a5ca84acb4d389 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:18.415305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:18.417011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:18.432599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f813bc0-ab9f-40c1-84da-f59f2c13281c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:18.486583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:18.498456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:18.499375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:18.499937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:18.500321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] PATH_INFO: `/v3/users/d96b91ab82414f4fb01e23384bde88ba` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:18.501671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96b91ab82414f4fb01e23384bde88ba)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:18.503921 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:18.562829 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96b91ab82414f4fb01e23384bde88ba'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:18.572820 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96b91ab82414f4fb01e23384bde88ba'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:18.573483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96b91ab82414f4fb01e23384bde88ba'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:18.589366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96b91ab82414f4fb01e23384bde88ba'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:18.596756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f1592b1-b490-47ee-b981-9012d22d07f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96b91ab82414f4fb01e23384bde88ba'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:18.603044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1015/2078] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:18 2022] DELETE /identity/v3/users/d96b91ab82414f4fb01e23384bde88ba => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:18.911469 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:18.913072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:18.932383 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b551-5a71-4238-ad2f-49cc48ad2689 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:18.995055 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:18.996027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:18.996381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:18.996731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] PATH_INFO: `/v3/projects/132fbb93d3fa411cb05d8b649f90e95f` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:18.998039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] RBAC: Authorizing `identity:delete_project(project_id=132fbb93d3fa411cb05d8b649f90e95f)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.000036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.051234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132fbb93d3fa411cb05d8b649f90e95f', 'request_id': 'req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:19.060945 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132fbb93d3fa411cb05d8b649f90e95f', 'request_id': 'req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:19.068527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132fbb93d3fa411cb05d8b649f90e95f', 'request_id': 'req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:19.081132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] The token cache is being invalidate because project 132fbb93d3fa411cb05d8b649f90e95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:19.081429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:19.082208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a0253df0-db67-4e34-8f4e-f9cd6bbd497b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:19.084193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1064/2079] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:18 2022] DELETE /identity/v3/projects/132fbb93d3fa411cb05d8b649f90e95f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:19.090520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bd0e3-df2a-4e23-9104-7211fadfd7b7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.090520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bd0e3-df2a-4e23-9104-7211fadfd7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.090757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bd0e3-df2a-4e23-9104-7211fadfd7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.110189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5f6bd0e3-df2a-4e23-9104-7211fadfd7b7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:19.111460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5f6bd0e3-df2a-4e23-9104-7211fadfd7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:19.177296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1016/2080] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:19.186413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05237141-d8bd-42a9-8580-3af819649949 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.186768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05237141-d8bd-42a9-8580-3af819649949 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.187051 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05237141-d8bd-42a9-8580-3af819649949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.205654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-05237141-d8bd-42a9-8580-3af819649949 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:19.206963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-05237141-d8bd-42a9-8580-3af819649949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:19.216257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1065/2081] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:19.220661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bd0e3-df2a-4e23-9104-7211fadfd7b7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:19.230767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bd0e3-df2a-4e23-9104-7211fadfd7b7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.235839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972cc1e-f070-4134-8b15-e96e7656b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.236496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972cc1e-f070-4134-8b15-e96e7656b86e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.236775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972cc1e-f070-4134-8b15-e96e7656b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.237048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972cc1e-f070-4134-8b15-e96e7656b86e admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.237777 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972cc1e-f070-4134-8b15-e96e7656b86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:19.238084 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972cc1e-f070-4134-8b15-e96e7656b86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.239752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972cc1e-f070-4134-8b15-e96e7656b86e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.252060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1017/2082] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:23:19.256629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05237141-d8bd-42a9-8580-3af819649949 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:19.266539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05237141-d8bd-42a9-8580-3af819649949 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.271312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ed7a1-8264-440a-b969-6176818c3659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.272221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ed7a1-8264-440a-b969-6176818c3659 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.272492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ed7a1-8264-440a-b969-6176818c3659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.272766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ed7a1-8264-440a-b969-6176818c3659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.273575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ed7a1-8264-440a-b969-6176818c3659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.275768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ed7a1-8264-440a-b969-6176818c3659 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.304417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1066/2083] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:19 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:19.311988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972cc1e-f070-4134-8b15-e96e7656b86e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:19.322399 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972cc1e-f070-4134-8b15-e96e7656b86e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.383694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781efe7-bf32-46a5-9e83-2ba89591f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.384363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781efe7-bf32-46a5-9e83-2ba89591f401 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.384651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781efe7-bf32-46a5-9e83-2ba89591f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.384933 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781efe7-bf32-46a5-9e83-2ba89591f401 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.385718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781efe7-bf32-46a5-9e83-2ba89591f401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.387849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781efe7-bf32-46a5-9e83-2ba89591f401 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.396240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:19.413283 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1018/2084] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:19 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:19.417517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ed7a1-8264-440a-b969-6176818c3659 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:19.429833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ed7a1-8264-440a-b969-6176818c3659 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.435754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b287ff-da69-4310-92cb-d92f92540598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.436458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b287ff-da69-4310-92cb-d92f92540598 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.436742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b287ff-da69-4310-92cb-d92f92540598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.437023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b287ff-da69-4310-92cb-d92f92540598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.437786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b287ff-da69-4310-92cb-d92f92540598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.439606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b287ff-da69-4310-92cb-d92f92540598 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.451858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1067/2085] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:19.456122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781efe7-bf32-46a5-9e83-2ba89591f401 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:19.468254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781efe7-bf32-46a5-9e83-2ba89591f401 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.474436 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aa65d-0f99-4d6c-b3df-976c71e045e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.475079 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa65d-0f99-4d6c-b3df-976c71e045e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.475429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa65d-0f99-4d6c-b3df-976c71e045e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.475782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa65d-0f99-4d6c-b3df-976c71e045e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.476756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03aa65d-0f99-4d6c-b3df-976c71e045e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.478540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03aa65d-0f99-4d6c-b3df-976c71e045e0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.492704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1019/2086] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:19.494093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b287ff-da69-4310-92cb-d92f92540598 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:19.504578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b287ff-da69-4310-92cb-d92f92540598 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.510170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebc9cd-f002-480e-a5b2-df9904fbf7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.511145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc9cd-f002-480e-a5b2-df9904fbf7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.511437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc9cd-f002-480e-a5b2-df9904fbf7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.511717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc9cd-f002-480e-a5b2-df9904fbf7f1 admin admin] PATH_INFO: `/v3/projects/80148fb053bc4f21b8371f976d360623/users/91cb6d47ee7645cdbd4ba0bf51379f84/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.528101 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebc9cd-f002-480e-a5b2-df9904fbf7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80148fb053bc4f21b8371f976d360623, user_id=91cb6d47ee7645cdbd4ba0bf51379f84, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.531179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebc9cd-f002-480e-a5b2-df9904fbf7f1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.542165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:19.547205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1068/2087] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:19 2022] PUT /identity/v3/projects/80148fb053bc4f21b8371f976d360623/users/91cb6d47ee7645cdbd4ba0bf51379f84/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:19.558626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262f86f-35c5-4218-ae38-1382581b7d82 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.558921 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262f86f-35c5-4218-ae38-1382581b7d82 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.559208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262f86f-35c5-4218-ae38-1382581b7d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.588130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2262f86f-35c5-4218-ae38-1382581b7d82 None None] MFA Rules not processed for user `91cb6d47ee7645cdbd4ba0bf51379f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:19.589488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2262f86f-35c5-4218-ae38-1382581b7d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:19.668624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1020/2088] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:19.673331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebc9cd-f002-480e-a5b2-df9904fbf7f1 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:19.746586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebc9cd-f002-480e-a5b2-df9904fbf7f1 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.752380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea0c7b-eac3-4758-8389-81f92f7afa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.753153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea0c7b-eac3-4758-8389-81f92f7afa0f admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.753590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea0c7b-eac3-4758-8389-81f92f7afa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.753967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea0c7b-eac3-4758-8389-81f92f7afa0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.754895 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea0c7b-eac3-4758-8389-81f92f7afa0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.757133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea0c7b-eac3-4758-8389-81f92f7afa0f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.786725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1069/2089] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:19 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:19.791102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262f86f-35c5-4218-ae38-1382581b7d82 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:19.802799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262f86f-35c5-4218-ae38-1382581b7d82 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.866168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aa6aa-f07b-4eeb-978d-2da33b810b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.866947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aa6aa-f07b-4eeb-978d-2da33b810b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.867236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aa6aa-f07b-4eeb-978d-2da33b810b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.867505 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aa6aa-f07b-4eeb-978d-2da33b810b71 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.868220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aa6aa-f07b-4eeb-978d-2da33b810b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.870222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aa6aa-f07b-4eeb-978d-2da33b810b71 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.890545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1021/2090] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:19 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:19.895611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea0c7b-eac3-4758-8389-81f92f7afa0f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:19.908229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea0c7b-eac3-4758-8389-81f92f7afa0f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.914217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53ede0-f60a-4059-a935-0b5b28117034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.915026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53ede0-f60a-4059-a935-0b5b28117034 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.915303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53ede0-f60a-4059-a935-0b5b28117034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.915576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53ede0-f60a-4059-a935-0b5b28117034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.916313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53ede0-f60a-4059-a935-0b5b28117034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.917975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53ede0-f60a-4059-a935-0b5b28117034 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.929844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1070/2091] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:19.934360 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aa6aa-f07b-4eeb-978d-2da33b810b71 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:19.945928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aa6aa-f07b-4eeb-978d-2da33b810b71 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.952383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4d1ea-8003-477f-8c63-528d1447c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.953389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4d1ea-8003-477f-8c63-528d1447c325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.953780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4d1ea-8003-477f-8c63-528d1447c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.954146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4d1ea-8003-477f-8c63-528d1447c325 admin admin] PATH_INFO: `/v3/projects/e4ee997a40aa4d53b83512050dfc123c/users/a3b08f2aa74d4deda10120cf07467efb/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.971450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4d1ea-8003-477f-8c63-528d1447c325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ee997a40aa4d53b83512050dfc123c, user_id=a3b08f2aa74d4deda10120cf07467efb, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.974229 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4d1ea-8003-477f-8c63-528d1447c325 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.990193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1022/2092] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:19 2022] PUT /identity/v3/projects/e4ee997a40aa4d53b83512050dfc123c/users/a3b08f2aa74d4deda10120cf07467efb/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:19.994465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53ede0-f60a-4059-a935-0b5b28117034 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:20.005365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53ede0-f60a-4059-a935-0b5b28117034 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:20.070658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887e9d3-337e-404c-84df-80461dc4a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:20.071342 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887e9d3-337e-404c-84df-80461dc4a7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.071637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887e9d3-337e-404c-84df-80461dc4a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.071921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887e9d3-337e-404c-84df-80461dc4a7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:20.072644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887e9d3-337e-404c-84df-80461dc4a7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:20.074297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887e9d3-337e-404c-84df-80461dc4a7f5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:20.087751 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1071/2093] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:20.089294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4d1ea-8003-477f-8c63-528d1447c325 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:20.103289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4d1ea-8003-477f-8c63-528d1447c325 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:20.107985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c066b-fbc4-45db-ba94-9863867c3117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:20.108879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c066b-fbc4-45db-ba94-9863867c3117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.109157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c066b-fbc4-45db-ba94-9863867c3117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.109427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c066b-fbc4-45db-ba94-9863867c3117 admin admin] PATH_INFO: `/v3/projects/e4ee997a40aa4d53b83512050dfc123c/users/a3b08f2aa74d4deda10120cf07467efb/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:20.111481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c066b-fbc4-45db-ba94-9863867c3117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ee997a40aa4d53b83512050dfc123c, user_id=a3b08f2aa74d4deda10120cf07467efb, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:20.114138 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c066b-fbc4-45db-ba94-9863867c3117 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:20.125672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1023/2094] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:20 2022] PUT /identity/v3/projects/e4ee997a40aa4d53b83512050dfc123c/users/a3b08f2aa74d4deda10120cf07467efb/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:20.136781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1137-f00d-4731-a397-e60464092bc0 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.137217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1137-f00d-4731-a397-e60464092bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.137585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1137-f00d-4731-a397-e60464092bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:20.165365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-f4df1137-f00d-4731-a397-e60464092bc0 None None] MFA Rules not processed for user `a3b08f2aa74d4deda10120cf07467efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:20.166674 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f4df1137-f00d-4731-a397-e60464092bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:20.229742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:20.239747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1072/2095] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:20.257799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c066b-fbc4-45db-ba94-9863867c3117 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:20.259616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-254c066b-fbc4-45db-ba94-9863867c3117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:20.282971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:20.326945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c066b-fbc4-45db-ba94-9863867c3117 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:20.331276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d337e-5859-41af-aa8e-e361d4f84042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:20.331938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d337e-5859-41af-aa8e-e361d4f84042 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.332231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d337e-5859-41af-aa8e-e361d4f84042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.332493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d337e-5859-41af-aa8e-e361d4f84042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:20.342473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d337e-5859-41af-aa8e-e361d4f84042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:20.343931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d337e-5859-41af-aa8e-e361d4f84042 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:20.358965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1024/2096] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:20.432495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1137-f00d-4731-a397-e60464092bc0 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:20.448130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1137-f00d-4731-a397-e60464092bc0 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:20.453072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293875ba-5111-420e-9705-1d05d5cc0194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:20.453820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293875ba-5111-420e-9705-1d05d5cc0194 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.454222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293875ba-5111-420e-9705-1d05d5cc0194 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.454595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293875ba-5111-420e-9705-1d05d5cc0194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:20.518627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293875ba-5111-420e-9705-1d05d5cc0194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:20.520032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293875ba-5111-420e-9705-1d05d5cc0194 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:20.529595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1073/2097] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:20.812981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d337e-5859-41af-aa8e-e361d4f84042 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:20.889796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d337e-5859-41af-aa8e-e361d4f84042 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:20.895242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:20.896295 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.896578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.896848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] PATH_INFO: `/v3/users/91cb6d47ee7645cdbd4ba0bf51379f84` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:20.898160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91cb6d47ee7645cdbd4ba0bf51379f84)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:20.900274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:20.953317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91cb6d47ee7645cdbd4ba0bf51379f84'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:20.961807 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91cb6d47ee7645cdbd4ba0bf51379f84'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:20.962408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91cb6d47ee7645cdbd4ba0bf51379f84'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:20.974864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91cb6d47ee7645cdbd4ba0bf51379f84'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:20.982296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91cb6d47ee7645cdbd4ba0bf51379f84'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:20.988368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1025/2098] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:20 2022] DELETE /identity/v3/users/91cb6d47ee7645cdbd4ba0bf51379f84 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:20.993307 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fa7c5-abbf-4eb1-9a42-601045d2b45a None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.993547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fa7c5-abbf-4eb1-9a42-601045d2b45a None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.993893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fa7c5-abbf-4eb1-9a42-601045d2b45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:21.016286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-bf8fa7c5-abbf-4eb1-9a42-601045d2b45a None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:21.017494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-bf8fa7c5-abbf-4eb1-9a42-601045d2b45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:21.078344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1074/2099] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:21.088492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:21.090144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:21.142414 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:21.156632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d870d-85bc-4108-844b-b95d2bac2807 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:21.160789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd88672-083e-448e-8e23-9c0490fb527e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:21.161445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88672-083e-448e-8e23-9c0490fb527e service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:21.161731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88672-083e-448e-8e23-9c0490fb527e service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:21.162007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88672-083e-448e-8e23-9c0490fb527e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:21.172040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd88672-083e-448e-8e23-9c0490fb527e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:21.173444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd88672-083e-448e-8e23-9c0490fb527e service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:21.183398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1026/2100] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:21.481300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fa7c5-abbf-4eb1-9a42-601045d2b45a None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:21.482880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-bf8fa7c5-abbf-4eb1-9a42-601045d2b45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:21.494933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fa7c5-abbf-4eb1-9a42-601045d2b45a None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:21.500702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:21.501605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:21.501888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:21.502228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] PATH_INFO: `/v3/projects/80148fb053bc4f21b8371f976d360623` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:21.503651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=80148fb053bc4f21b8371f976d360623)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:21.506728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:21.557436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80148fb053bc4f21b8371f976d360623', 'request_id': 'req-501772f1-614f-420f-8e40-82a569dbcd7d'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.566667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80148fb053bc4f21b8371f976d360623', 'request_id': 'req-501772f1-614f-420f-8e40-82a569dbcd7d'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.573541 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80148fb053bc4f21b8371f976d360623', 'request_id': 'req-501772f1-614f-420f-8e40-82a569dbcd7d'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.584938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] The token cache is being invalidate because project 80148fb053bc4f21b8371f976d360623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:21.585224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.585899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.587926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1075/2101] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:21 2022] DELETE /identity/v3/projects/80148fb053bc4f21b8371f976d360623 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:21.592206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd88672-083e-448e-8e23-9c0490fb527e service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:21.602297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd88672-083e-448e-8e23-9c0490fb527e service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:21.661213 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:21.662115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:21.662379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:21.662683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] PATH_INFO: `/v3/users/a3b08f2aa74d4deda10120cf07467efb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:21.663901 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b08f2aa74d4deda10120cf07467efb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:21.665846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:21.713353 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b08f2aa74d4deda10120cf07467efb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.721713 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b08f2aa74d4deda10120cf07467efb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.722325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b08f2aa74d4deda10120cf07467efb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.734962 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b08f2aa74d4deda10120cf07467efb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.742458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e976226b-a26f-40fd-ae9a-9d2c4b8d98d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b08f2aa74d4deda10120cf07467efb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.748954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1027/2102] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:21 2022] DELETE /identity/v3/users/a3b08f2aa74d4deda10120cf07467efb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:22.032873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.034525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:22.057071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501772f1-614f-420f-8e40-82a569dbcd7d admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.074077 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:22.126315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.127234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.127514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.127773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] PATH_INFO: `/v3/projects/e4ee997a40aa4d53b83512050dfc123c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.128994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ee997a40aa4d53b83512050dfc123c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.131071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.180078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ee997a40aa4d53b83512050dfc123c', 'request_id': 'req-bda74049-7b29-4288-9fe4-ee605512d25c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:22.189096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ee997a40aa4d53b83512050dfc123c', 'request_id': 'req-bda74049-7b29-4288-9fe4-ee605512d25c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:22.195582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ee997a40aa4d53b83512050dfc123c', 'request_id': 'req-bda74049-7b29-4288-9fe4-ee605512d25c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:22.207052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] The token cache is being invalidate because project e4ee997a40aa4d53b83512050dfc123c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:22.207346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:22.208076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bda74049-7b29-4288-9fe4-ee605512d25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:22.209681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1076/2103] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:22 2022] DELETE /identity/v3/projects/e4ee997a40aa4d53b83512050dfc123c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:22.214975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8853ef-20fe-41e4-9385-5f92dd22fc83 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.215465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8853ef-20fe-41e4-9385-5f92dd22fc83 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.215619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8853ef-20fe-41e4-9385-5f92dd22fc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.235114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9f8853ef-20fe-41e4-9385-5f92dd22fc83 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:22.236338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9f8853ef-20fe-41e4-9385-5f92dd22fc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:22.305040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1028/2104] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:22.313314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b23d0-88bc-4345-a23e-3785ce2b7fbf None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.313609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b23d0-88bc-4345-a23e-3785ce2b7fbf None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.313889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b23d0-88bc-4345-a23e-3785ce2b7fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.333095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-5a6b23d0-88bc-4345-a23e-3785ce2b7fbf None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:22.334298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5a6b23d0-88bc-4345-a23e-3785ce2b7fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:22.343167 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1077/2105] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:22.347547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8853ef-20fe-41e4-9385-5f92dd22fc83 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.353620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:22.357851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8853ef-20fe-41e4-9385-5f92dd22fc83 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.364313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8265d-61b7-4864-9ee4-b0879dec3a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.365116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8265d-61b7-4864-9ee4-b0879dec3a21 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.365492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8265d-61b7-4864-9ee4-b0879dec3a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.365795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8265d-61b7-4864-9ee4-b0879dec3a21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.367258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8265d-61b7-4864-9ee4-b0879dec3a21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:22.367691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8265d-61b7-4864-9ee4-b0879dec3a21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.369687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8265d-61b7-4864-9ee4-b0879dec3a21 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.382189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1029/2106] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:23:22.386599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b23d0-88bc-4345-a23e-3785ce2b7fbf None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.404687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b23d0-88bc-4345-a23e-3785ce2b7fbf None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.410075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4be5df-67c2-495f-afe7-5733fda4ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.410856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4be5df-67c2-495f-afe7-5733fda4ddcf admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.411064 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4be5df-67c2-495f-afe7-5733fda4ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.411341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4be5df-67c2-495f-afe7-5733fda4ddcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.412046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4be5df-67c2-495f-afe7-5733fda4ddcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.414022 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4be5df-67c2-495f-afe7-5733fda4ddcf admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.446705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1078/2107] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:22 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:22.450948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8265d-61b7-4864-9ee4-b0879dec3a21 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.462563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8265d-61b7-4864-9ee4-b0879dec3a21 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.536116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3a6ab-fe87-429e-994b-47bd056e7e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.536862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3a6ab-fe87-429e-994b-47bd056e7e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.537183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3a6ab-fe87-429e-994b-47bd056e7e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.537448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3a6ab-fe87-429e-994b-47bd056e7e80 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.538177 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3a6ab-fe87-429e-994b-47bd056e7e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.540269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3a6ab-fe87-429e-994b-47bd056e7e80 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.561616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1030/2108] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:22 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:22.565837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4be5df-67c2-495f-afe7-5733fda4ddcf admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.576761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4be5df-67c2-495f-afe7-5733fda4ddcf admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.582053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a47e8a-f9a6-4059-8424-9766cb98ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.582773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a47e8a-f9a6-4059-8424-9766cb98ccdf admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.583062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a47e8a-f9a6-4059-8424-9766cb98ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.583534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a47e8a-f9a6-4059-8424-9766cb98ccdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.584318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a47e8a-f9a6-4059-8424-9766cb98ccdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.586044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a47e8a-f9a6-4059-8424-9766cb98ccdf admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.597146 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1079/2109] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:23:22.602108 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3a6ab-fe87-429e-994b-47bd056e7e80 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.614317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3a6ab-fe87-429e-994b-47bd056e7e80 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.619994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8180190-691a-4974-87cd-8992ffc613c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.620657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8180190-691a-4974-87cd-8992ffc613c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.620947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8180190-691a-4974-87cd-8992ffc613c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.621279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8180190-691a-4974-87cd-8992ffc613c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.621972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8180190-691a-4974-87cd-8992ffc613c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.623762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8180190-691a-4974-87cd-8992ffc613c1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.641903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1031/2110] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:22.645937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a47e8a-f9a6-4059-8424-9766cb98ccdf admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.656596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a47e8a-f9a6-4059-8424-9766cb98ccdf admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.661254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d04ad7-c718-4e17-a3e0-60252ac756e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.662163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d04ad7-c718-4e17-a3e0-60252ac756e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.662462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d04ad7-c718-4e17-a3e0-60252ac756e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.662772 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d04ad7-c718-4e17-a3e0-60252ac756e2 admin admin] PATH_INFO: `/v3/projects/10999a74873940d088d8e5466dfa7b17/users/dfb9fb1a3d044014a100dea28abb81df/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.677632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d04ad7-c718-4e17-a3e0-60252ac756e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10999a74873940d088d8e5466dfa7b17, user_id=dfb9fb1a3d044014a100dea28abb81df, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.680416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d04ad7-c718-4e17-a3e0-60252ac756e2 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.694779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1080/2111] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:22 2022] PUT /identity/v3/projects/10999a74873940d088d8e5466dfa7b17/users/dfb9fb1a3d044014a100dea28abb81df/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:22.706275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cf793-a4bf-4753-8e06-1d3814ff8a5f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.706607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cf793-a4bf-4753-8e06-1d3814ff8a5f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.706897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cf793-a4bf-4753-8e06-1d3814ff8a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.736814 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0a5cf793-a4bf-4753-8e06-1d3814ff8a5f None None] MFA Rules not processed for user `dfb9fb1a3d044014a100dea28abb81df`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:22.739045 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0a5cf793-a4bf-4753-8e06-1d3814ff8a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:22.830442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1032/2112] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:22.842147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d04ad7-c718-4e17-a3e0-60252ac756e2 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.844180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-67d04ad7-c718-4e17-a3e0-60252ac756e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:22.895200 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:22.909189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d04ad7-c718-4e17-a3e0-60252ac756e2 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.913299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514f412-39e5-4cee-b98a-71ff2a96afdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.914079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514f412-39e5-4cee-b98a-71ff2a96afdf service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.914364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514f412-39e5-4cee-b98a-71ff2a96afdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.914682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514f412-39e5-4cee-b98a-71ff2a96afdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.923289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514f412-39e5-4cee-b98a-71ff2a96afdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.924742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514f412-39e5-4cee-b98a-71ff2a96afdf service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.933914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1081/2113] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:22.962540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cf793-a4bf-4753-8e06-1d3814ff8a5f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:23.029787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cf793-a4bf-4753-8e06-1d3814ff8a5f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:23.035425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:23.036310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:23.036586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:23.036860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] PATH_INFO: `/v3/users/dfb9fb1a3d044014a100dea28abb81df` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:23.038110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb9fb1a3d044014a100dea28abb81df)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:23.040098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:23.041626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:23.089441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb9fb1a3d044014a100dea28abb81df'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:23.097816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb9fb1a3d044014a100dea28abb81df'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:23.098468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb9fb1a3d044014a100dea28abb81df'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:23.110784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb9fb1a3d044014a100dea28abb81df'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:23.118006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb9fb1a3d044014a100dea28abb81df'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:23.124551 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1033/2114] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:22 2022] DELETE /identity/v3/users/dfb9fb1a3d044014a100dea28abb81df => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:23.130938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ca6d-7a80-40c6-848c-4b3069038655 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:23.131400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ca6d-7a80-40c6-848c-4b3069038655 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:23.131753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ca6d-7a80-40c6-848c-4b3069038655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:23.154314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b813ca6d-7a80-40c6-848c-4b3069038655 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:23.155976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b813ca6d-7a80-40c6-848c-4b3069038655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:23.220326 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1082/2115] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:23.230236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:23.231804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:23.295470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e538f-f502-40b1-8ebd-caf11400422c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:23.299765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53f00-9aea-42ca-bf5f-8562a1cbcf46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:23.300404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53f00-9aea-42ca-bf5f-8562a1cbcf46 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:23.300683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53f00-9aea-42ca-bf5f-8562a1cbcf46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:23.300951 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53f00-9aea-42ca-bf5f-8562a1cbcf46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:23.311877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e53f00-9aea-42ca-bf5f-8562a1cbcf46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:23.313310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e53f00-9aea-42ca-bf5f-8562a1cbcf46 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:23.323186 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1034/2116] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:23.688723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813ca6d-7a80-40c6-848c-4b3069038655 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:23.690312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b813ca6d-7a80-40c6-848c-4b3069038655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:23.702483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813ca6d-7a80-40c6-848c-4b3069038655 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:23.707686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:23.708721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:23.709009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:23.709285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] PATH_INFO: `/v3/projects/10999a74873940d088d8e5466dfa7b17` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:23.710492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10999a74873940d088d8e5466dfa7b17)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:23.712529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:23.768145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10999a74873940d088d8e5466dfa7b17', 'request_id': 'req-acdce33e-8348-4403-aa8e-f05a5551ec0c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:23.776354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10999a74873940d088d8e5466dfa7b17', 'request_id': 'req-acdce33e-8348-4403-aa8e-f05a5551ec0c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:23.783079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10999a74873940d088d8e5466dfa7b17', 'request_id': 'req-acdce33e-8348-4403-aa8e-f05a5551ec0c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:23.793645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] The token cache is being invalidate because project 10999a74873940d088d8e5466dfa7b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:23.793943 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:23.794594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-acdce33e-8348-4403-aa8e-f05a5551ec0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:23.796158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1083/2117] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:23 2022] DELETE /identity/v3/projects/10999a74873940d088d8e5466dfa7b17 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:23.801277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f30ea-a6d9-4603-81e0-68f3543fa8c7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:23.801748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f30ea-a6d9-4603-81e0-68f3543fa8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:23.802029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f30ea-a6d9-4603-81e0-68f3543fa8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:23.820148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f53f30ea-a6d9-4603-81e0-68f3543fa8c7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:23.821374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f53f30ea-a6d9-4603-81e0-68f3543fa8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:23.892742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1035/2118] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:23.900487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce23d5-b5a2-4755-a214-31362f91c436 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:23.900780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce23d5-b5a2-4755-a214-31362f91c436 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:23.901060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce23d5-b5a2-4755-a214-31362f91c436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:23.921413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-48ce23d5-b5a2-4755-a214-31362f91c436 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:23.922654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-48ce23d5-b5a2-4755-a214-31362f91c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:23.931204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1084/2119] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:23.935481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f30ea-a6d9-4603-81e0-68f3543fa8c7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:23.945649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f30ea-a6d9-4603-81e0-68f3543fa8c7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:23.951072 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5002-c536-448a-911a-2af0ae692f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:23.951731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5002-c536-448a-911a-2af0ae692f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:23.952013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5002-c536-448a-911a-2af0ae692f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:23.952287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5002-c536-448a-911a-2af0ae692f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:23.953019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c5002-c536-448a-911a-2af0ae692f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:23.953329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c5002-c536-448a-911a-2af0ae692f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:23.954986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c5002-c536-448a-911a-2af0ae692f35 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:23.966765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1036/2120] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:23:23.971249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce23d5-b5a2-4755-a214-31362f91c436 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:23.981339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce23d5-b5a2-4755-a214-31362f91c436 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:23.987241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644faf-b7ff-434b-b8a7-bac517688881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:23.987907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644faf-b7ff-434b-b8a7-bac517688881 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:23.988184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644faf-b7ff-434b-b8a7-bac517688881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:23.988453 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644faf-b7ff-434b-b8a7-bac517688881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:23.989174 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18644faf-b7ff-434b-b8a7-bac517688881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:23.991105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18644faf-b7ff-434b-b8a7-bac517688881 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:24.018203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1085/2121] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:23 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:24.023966 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5002-c536-448a-911a-2af0ae692f35 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:24.035077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5002-c536-448a-911a-2af0ae692f35 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:24.040725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:24.102814 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbfccd-9c34-497b-85b2-2577151dc5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:24.103487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfccd-9c34-497b-85b2-2577151dc5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.103768 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfccd-9c34-497b-85b2-2577151dc5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.104035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfccd-9c34-497b-85b2-2577151dc5b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.104731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbfccd-9c34-497b-85b2-2577151dc5b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:24.106757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbfccd-9c34-497b-85b2-2577151dc5b1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:24.128280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1037/2122] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:24 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:24.132563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644faf-b7ff-434b-b8a7-bac517688881 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:24.143839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644faf-b7ff-434b-b8a7-bac517688881 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:24.149641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608eec1-e857-4351-ad2f-63092a53de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:24.150311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608eec1-e857-4351-ad2f-63092a53de0c admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.150624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608eec1-e857-4351-ad2f-63092a53de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.150893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608eec1-e857-4351-ad2f-63092a53de0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.151632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608eec1-e857-4351-ad2f-63092a53de0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:24.153247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608eec1-e857-4351-ad2f-63092a53de0c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:24.164252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1086/2123] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:24.168475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbfccd-9c34-497b-85b2-2577151dc5b1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:24.179939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbfccd-9c34-497b-85b2-2577151dc5b1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:24.185595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a94bd0-b89f-4dad-872c-9cf65dd9e75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:24.186197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94bd0-b89f-4dad-872c-9cf65dd9e75d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.186477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94bd0-b89f-4dad-872c-9cf65dd9e75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.186815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94bd0-b89f-4dad-872c-9cf65dd9e75d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.187659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94bd0-b89f-4dad-872c-9cf65dd9e75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:24.189282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94bd0-b89f-4dad-872c-9cf65dd9e75d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:24.204607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1038/2124] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:23:24.209128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608eec1-e857-4351-ad2f-63092a53de0c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:24.219876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608eec1-e857-4351-ad2f-63092a53de0c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:24.224917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032da107-8f7e-4e17-88d5-5d3b33b1e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:24.225800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032da107-8f7e-4e17-88d5-5d3b33b1e6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.226076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032da107-8f7e-4e17-88d5-5d3b33b1e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.226347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032da107-8f7e-4e17-88d5-5d3b33b1e6ae admin admin] PATH_INFO: `/v3/projects/fdf8141dafa34d6a8ceb22e075dd17c7/users/c3d5d43b65a944cfa07ee78d8639e465/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.241914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032da107-8f7e-4e17-88d5-5d3b33b1e6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf8141dafa34d6a8ceb22e075dd17c7, user_id=c3d5d43b65a944cfa07ee78d8639e465, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:24.244720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032da107-8f7e-4e17-88d5-5d3b33b1e6ae admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:24.260373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1087/2125] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:24 2022] PUT /identity/v3/projects/fdf8141dafa34d6a8ceb22e075dd17c7/users/c3d5d43b65a944cfa07ee78d8639e465/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:24.271196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e54f20-cabf-4292-b56a-ee3a57222cbe None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.271816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e54f20-cabf-4292-b56a-ee3a57222cbe None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.271816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e54f20-cabf-4292-b56a-ee3a57222cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.301251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f1e54f20-cabf-4292-b56a-ee3a57222cbe None None] MFA Rules not processed for user `c3d5d43b65a944cfa07ee78d8639e465`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:24.302471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f1e54f20-cabf-4292-b56a-ee3a57222cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:24.379269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1039/2126] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:24.391344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032da107-8f7e-4e17-88d5-5d3b33b1e6ae admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:24.393178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-032da107-8f7e-4e17-88d5-5d3b33b1e6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:24.403697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:24.460667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032da107-8f7e-4e17-88d5-5d3b33b1e6ae admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:24.465406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b12af-038c-4abc-8db2-de37ca7ec5ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0055a33a380435d83a6d7384417c10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:24.466061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b12af-038c-4abc-8db2-de37ca7ec5ed service glance] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.466338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b12af-038c-4abc-8db2-de37ca7ec5ed service glance] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.466663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b12af-038c-4abc-8db2-de37ca7ec5ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.476003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b12af-038c-4abc-8db2-de37ca7ec5ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:24.477440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b12af-038c-4abc-8db2-de37ca7ec5ed service glance] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:24.486697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1088/2127] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:27.143055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e6713-b2ba-43a5-a3d5-763236e8bd96 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:27.143538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e6713-b2ba-43a5-a3d5-763236e8bd96 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:27.143653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e6713-b2ba-43a5-a3d5-763236e8bd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:27.180702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0b1e6713-b2ba-43a5-a3d5-763236e8bd96 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:27.182433 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0b1e6713-b2ba-43a5-a3d5-763236e8bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:27.265296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1040/2128] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:23:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:27.316399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b12af-038c-4abc-8db2-de37ca7ec5ed service glance] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:27.317866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-789b12af-038c-4abc-8db2-de37ca7ec5ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:27.393793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b12af-038c-4abc-8db2-de37ca7ec5ed service glance] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:27.399689 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f546e-3f1b-4f56-96e3-cbe49b332da4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:27.400348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f546e-3f1b-4f56-96e3-cbe49b332da4 service swift] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:27.400637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f546e-3f1b-4f56-96e3-cbe49b332da4 service swift] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:27.400908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f546e-3f1b-4f56-96e3-cbe49b332da4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:27.411203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f546e-3f1b-4f56-96e3-cbe49b332da4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:27.412936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f546e-3f1b-4f56-96e3-cbe49b332da4 service swift] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:27.422145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1089/2129] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:23:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:23:37.257003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:37.350646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e6713-b2ba-43a5-a3d5-763236e8bd96 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:37.352091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0b1e6713-b2ba-43a5-a3d5-763236e8bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:37.419448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=55 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:37.435365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e6713-b2ba-43a5-a3d5-763236e8bd96 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:37.439218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2282b-70b9-4c52-8dbf-73a07673f172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:37.440124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2282b-70b9-4c52-8dbf-73a07673f172 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:37.440448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2282b-70b9-4c52-8dbf-73a07673f172 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:37.440825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2282b-70b9-4c52-8dbf-73a07673f172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:37.442886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5cf2282b-70b9-4c52-8dbf-73a07673f172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:37.501888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f546e-3f1b-4f56-96e3-cbe49b332da4 service swift] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:37.503850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-724f546e-3f1b-4f56-96e3-cbe49b332da4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:37.526245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2282b-70b9-4c52-8dbf-73a07673f172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:37.527842 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2282b-70b9-4c52-8dbf-73a07673f172 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:37.542549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1041/2130] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:37.669919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f546e-3f1b-4f56-96e3-cbe49b332da4 service swift] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:37.687825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87be72c-e469-49a0-8e93-02c04dc3ef78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:37.688178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87be72c-e469-49a0-8e93-02c04dc3ef78 service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:37.688465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87be72c-e469-49a0-8e93-02c04dc3ef78 service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:37.688804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87be72c-e469-49a0-8e93-02c04dc3ef78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:37.694692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d87be72c-e469-49a0-8e93-02c04dc3ef78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:37.746326 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87be72c-e469-49a0-8e93-02c04dc3ef78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:37.748437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87be72c-e469-49a0-8e93-02c04dc3ef78 service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:37.766286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1090/2131] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:23:42.208702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097eaaa-0e1c-4ce0-a824-b0e868459ace None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:42.209267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097eaaa-0e1c-4ce0-a824-b0e868459ace None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:42.209267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097eaaa-0e1c-4ce0-a824-b0e868459ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:42.228440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d097eaaa-0e1c-4ce0-a824-b0e868459ace None None] MFA Rules not processed for user `8fc916f852f4433eac4a3a2a12384834`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:42.229616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d097eaaa-0e1c-4ce0-a824-b0e868459ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:42.334672 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1042/2132] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:47.758074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=41 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:48.023020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541ec9-286f-4381-a8fe-c92475b178a8 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:48.023420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541ec9-286f-4381-a8fe-c92475b178a8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:48.023708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541ec9-286f-4381-a8fe-c92475b178a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:48.071946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-5b541ec9-286f-4381-a8fe-c92475b178a8 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:48.073148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5b541ec9-286f-4381-a8fe-c92475b178a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:48.097174 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1091/2133] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 10:23:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:48.111421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097eaaa-0e1c-4ce0-a824-b0e868459ace None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:48.135340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097eaaa-0e1c-4ce0-a824-b0e868459ace None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:48.142134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49876ee8-3a21-4b1f-9503-6dc513227d31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:48.142824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49876ee8-3a21-4b1f-9503-6dc513227d31 service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:48.143103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49876ee8-3a21-4b1f-9503-6dc513227d31 service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:48.143375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49876ee8-3a21-4b1f-9503-6dc513227d31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:48.153100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49876ee8-3a21-4b1f-9503-6dc513227d31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:48.154733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49876ee8-3a21-4b1f-9503-6dc513227d31 service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:48.163986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1043/2134] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:23:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:23:50.155842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541ec9-286f-4381-a8fe-c92475b178a8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:50.157540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5b541ec9-286f-4381-a8fe-c92475b178a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:50.223536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541ec9-286f-4381-a8fe-c92475b178a8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:50.228318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:50.229192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:50.229474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:50.229745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] PATH_INFO: `/v3/users/0d1dcf4b8dbb4e1698e7b0c4dc9c63a4` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:50.231567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1dcf4b8dbb4e1698e7b0c4dc9c63a4)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:50.232898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:50.285058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:50.285745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:50.286355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:50.298773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:50.310385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-1b5baa21-97f1-4b58-839c-e9c14e18a252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:50.325297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1092/2135] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:50 2022] DELETE /identity/v3/users/0d1dcf4b8dbb4e1698e7b0c4dc9c63a4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:50.509780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49876ee8-3a21-4b1f-9503-6dc513227d31 service swift] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:50.527748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49876ee8-3a21-4b1f-9503-6dc513227d31 service swift] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:50.559578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:50.587716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:50.588606 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:50.588916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:50.589191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] PATH_INFO: `/v3/projects/c5370eb5245247a68d7f224cdd457ea1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:50.590539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5370eb5245247a68d7f224cdd457ea1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:50.592458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:50.644604 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5370eb5245247a68d7f224cdd457ea1', 'request_id': 'req-b3104d99-40e1-4e18-b0be-b72a861ce99d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:50.650029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5370eb5245247a68d7f224cdd457ea1', 'request_id': 'req-b3104d99-40e1-4e18-b0be-b72a861ce99d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:50.659014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5370eb5245247a68d7f224cdd457ea1', 'request_id': 'req-b3104d99-40e1-4e18-b0be-b72a861ce99d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:50.671964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] The token cache is being invalidate because project c5370eb5245247a68d7f224cdd457ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:50.672272 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:50.673032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b3104d99-40e1-4e18-b0be-b72a861ce99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:50.674749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1044/2136] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:50 2022] DELETE /identity/v3/projects/c5370eb5245247a68d7f224cdd457ea1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:50.680033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9a844-a90b-4186-bf3e-d32959f82d66 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:50.680330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9a844-a90b-4186-bf3e-d32959f82d66 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:50.680610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9a844-a90b-4186-bf3e-d32959f82d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:50.699519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9af9a844-a90b-4186-bf3e-d32959f82d66 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:50.700811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9af9a844-a90b-4186-bf3e-d32959f82d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:50.737497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:50.767520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1093/2137] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:50.777219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae5e3-aa7f-4d89-bccc-69e1be42fc24 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:50.777514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae5e3-aa7f-4d89-bccc-69e1be42fc24 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:50.777796 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae5e3-aa7f-4d89-bccc-69e1be42fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:50.796715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a27ae5e3-aa7f-4d89-bccc-69e1be42fc24 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:50.797923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a27ae5e3-aa7f-4d89-bccc-69e1be42fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:50.807013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1045/2138] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:50.811508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9a844-a90b-4186-bf3e-d32959f82d66 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:50.822285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9a844-a90b-4186-bf3e-d32959f82d66 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:50.827119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b716436-ad39-44ce-b5c9-083f011ad3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:50.827785 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716436-ad39-44ce-b5c9-083f011ad3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:50.828031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716436-ad39-44ce-b5c9-083f011ad3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:50.828338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716436-ad39-44ce-b5c9-083f011ad3b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:50.829071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b716436-ad39-44ce-b5c9-083f011ad3b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:50.829382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b716436-ad39-44ce-b5c9-083f011ad3b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:50.831058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b716436-ad39-44ce-b5c9-083f011ad3b4 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:50.845049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1094/2139] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:23:50.849734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ae5e3-aa7f-4d89-bccc-69e1be42fc24 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:50.860019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ae5e3-aa7f-4d89-bccc-69e1be42fc24 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:50.865557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b24077-3e3d-4a97-b71f-ebc1d0c73c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:50.866217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b24077-3e3d-4a97-b71f-ebc1d0c73c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:50.866495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b24077-3e3d-4a97-b71f-ebc1d0c73c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:50.866792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b24077-3e3d-4a97-b71f-ebc1d0c73c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:50.867636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b24077-3e3d-4a97-b71f-ebc1d0c73c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:50.869555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b24077-3e3d-4a97-b71f-ebc1d0c73c59 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:50.899582 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1046/2140] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:50 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:50.903835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b716436-ad39-44ce-b5c9-083f011ad3b4 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:50.914980 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b716436-ad39-44ce-b5c9-083f011ad3b4 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:50.985248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f0854-0562-4904-9b37-de37971423bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:50.985939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f0854-0562-4904-9b37-de37971423bd admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:50.986246 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f0854-0562-4904-9b37-de37971423bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:50.986525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f0854-0562-4904-9b37-de37971423bd admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:50.987260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f0854-0562-4904-9b37-de37971423bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:50.989286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f0854-0562-4904-9b37-de37971423bd admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:51.014819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1095/2141] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:50 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:51.016094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b24077-3e3d-4a97-b71f-ebc1d0c73c59 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:51.027091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b24077-3e3d-4a97-b71f-ebc1d0c73c59 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:51.033134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f47147-6faa-4bd3-9ae3-41902d879e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:51.033827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f47147-6faa-4bd3-9ae3-41902d879e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:51.034109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f47147-6faa-4bd3-9ae3-41902d879e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:51.034386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f47147-6faa-4bd3-9ae3-41902d879e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:51.035168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f47147-6faa-4bd3-9ae3-41902d879e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:51.036783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f47147-6faa-4bd3-9ae3-41902d879e52 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:51.048009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1047/2142] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:51.052215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f0854-0562-4904-9b37-de37971423bd admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:51.063262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f0854-0562-4904-9b37-de37971423bd admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:51.069082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06912b00-e061-4456-b4b1-ce35bf07a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:51.069812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06912b00-e061-4456-b4b1-ce35bf07a3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:51.070143 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06912b00-e061-4456-b4b1-ce35bf07a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:51.070436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06912b00-e061-4456-b4b1-ce35bf07a3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:51.071271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06912b00-e061-4456-b4b1-ce35bf07a3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:51.072894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06912b00-e061-4456-b4b1-ce35bf07a3c0 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:51.083376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1096/2143] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:51.087767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f47147-6faa-4bd3-9ae3-41902d879e52 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:51.098462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f47147-6faa-4bd3-9ae3-41902d879e52 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:51.104362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7612-fd3b-42c7-8dff-f24f71ee60d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:51.105254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7612-fd3b-42c7-8dff-f24f71ee60d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:51.105538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7612-fd3b-42c7-8dff-f24f71ee60d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:51.105816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7612-fd3b-42c7-8dff-f24f71ee60d1 admin admin] PATH_INFO: `/v3/projects/c25e584bdfe9402c8c4ecc409fbf9b83/users/5d716ed903c44d00930b841605fe1750/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:51.121454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f7612-fd3b-42c7-8dff-f24f71ee60d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25e584bdfe9402c8c4ecc409fbf9b83, user_id=5d716ed903c44d00930b841605fe1750, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:51.124192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f7612-fd3b-42c7-8dff-f24f71ee60d1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:51.140301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1048/2144] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:51 2022] PUT /identity/v3/projects/c25e584bdfe9402c8c4ecc409fbf9b83/users/5d716ed903c44d00930b841605fe1750/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:51.150547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad281-3157-4fdd-adad-c26b8bbba0ea None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:51.150845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad281-3157-4fdd-adad-c26b8bbba0ea None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:51.151125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad281-3157-4fdd-adad-c26b8bbba0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:51.178865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b83ad281-3157-4fdd-adad-c26b8bbba0ea None None] MFA Rules not processed for user `5d716ed903c44d00930b841605fe1750`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:51.180215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b83ad281-3157-4fdd-adad-c26b8bbba0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:51.248809 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1097/2145] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:51.260841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7612-fd3b-42c7-8dff-f24f71ee60d1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:51.262637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9d5f7612-fd3b-42c7-8dff-f24f71ee60d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:51.338767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:51.356425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7612-fd3b-42c7-8dff-f24f71ee60d1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:51.360323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1541b5e-f018-48df-b259-478c38e4d5cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0055a33a380435d83a6d7384417c10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:51.360975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1541b5e-f018-48df-b259-478c38e4d5cb service glance] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:51.361259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1541b5e-f018-48df-b259-478c38e4d5cb service glance] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:51.361535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1541b5e-f018-48df-b259-478c38e4d5cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:51.371151 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1541b5e-f018-48df-b259-478c38e4d5cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:51.372608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1541b5e-f018-48df-b259-478c38e4d5cb service glance] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:51.381926 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1049/2146] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:58.265641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ad281-3157-4fdd-adad-c26b8bbba0ea None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:58.267595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b83ad281-3157-4fdd-adad-c26b8bbba0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:58.313293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:58.341882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ad281-3157-4fdd-adad-c26b8bbba0ea None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:58.346761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:58.347650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:58.347934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:58.348213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] PATH_INFO: `/v3/users/c3d5d43b65a944cfa07ee78d8639e465` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:58.349450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d5d43b65a944cfa07ee78d8639e465)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:58.351470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:58.409729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d5d43b65a944cfa07ee78d8639e465'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:58.410358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d5d43b65a944cfa07ee78d8639e465'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:58.411146 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d5d43b65a944cfa07ee78d8639e465'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:58.423467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d5d43b65a944cfa07ee78d8639e465'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:58.432403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d5d43b65a944cfa07ee78d8639e465'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:58.445960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1098/2147] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:58 2022] DELETE /identity/v3/users/c3d5d43b65a944cfa07ee78d8639e465 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:58.450803 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2d2e4-19e9-4547-a975-e3e9fdfff9d0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:58.451303 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2d2e4-19e9-4547-a975-e3e9fdfff9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:58.451474 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2d2e4-19e9-4547-a975-e3e9fdfff9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:58.471041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-dea2d2e4-19e9-4547-a975-e3e9fdfff9d0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:58.472297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dea2d2e4-19e9-4547-a975-e3e9fdfff9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:58.547956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1050/2148] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:58.560290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:58.561845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:58.653642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25fa1a-40e4-4bd4-91fa-fc20191578e5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:58.658273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d80a-9bc5-4755-841c-bd1ab19f09b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:58.658977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d80a-9bc5-4755-841c-bd1ab19f09b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:58.659263 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d80a-9bc5-4755-841c-bd1ab19f09b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:58.659263 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d80a-9bc5-4755-841c-bd1ab19f09b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:58.671633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d80a-9bc5-4755-841c-bd1ab19f09b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:58.674981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d80a-9bc5-4755-841c-bd1ab19f09b2 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:58.686666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1099/2149] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:59.006084 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2d2e4-19e9-4547-a975-e3e9fdfff9d0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:59.007626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dea2d2e4-19e9-4547-a975-e3e9fdfff9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:59.020538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2d2e4-19e9-4547-a975-e3e9fdfff9d0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:59.027282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:59.028184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.028469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.028737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] PATH_INFO: `/v3/projects/fdf8141dafa34d6a8ceb22e075dd17c7` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.030440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf8141dafa34d6a8ceb22e075dd17c7)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:59.032746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:59.085614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf8141dafa34d6a8ceb22e075dd17c7', 'request_id': 'req-63f36a52-11d2-4404-a10a-e9e9c6a7289a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:59.091414 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf8141dafa34d6a8ceb22e075dd17c7', 'request_id': 'req-63f36a52-11d2-4404-a10a-e9e9c6a7289a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:59.099693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf8141dafa34d6a8ceb22e075dd17c7', 'request_id': 'req-63f36a52-11d2-4404-a10a-e9e9c6a7289a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:59.112094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] The token cache is being invalidate because project fdf8141dafa34d6a8ceb22e075dd17c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:59.112385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:59.113174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-63f36a52-11d2-4404-a10a-e9e9c6a7289a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:59.114945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1051/2150] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:59 2022] DELETE /identity/v3/projects/fdf8141dafa34d6a8ceb22e075dd17c7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:59.120154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2ae75-c020-4873-a1f7-fc151fa8c7f2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.120448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2ae75-c020-4873-a1f7-fc151fa8c7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.120717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2ae75-c020-4873-a1f7-fc151fa8c7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.138852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9fa2ae75-c020-4873-a1f7-fc151fa8c7f2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:59.140069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9fa2ae75-c020-4873-a1f7-fc151fa8c7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:59.196549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:59.212186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1100/2151] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:59.221166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d0f7b-d168-453a-aea3-a36f5aedbcc2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.221453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d0f7b-d168-453a-aea3-a36f5aedbcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.221730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d0f7b-d168-453a-aea3-a36f5aedbcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.242108 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8b4d0f7b-d168-453a-aea3-a36f5aedbcc2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:59.243484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8b4d0f7b-d168-453a-aea3-a36f5aedbcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:59.252488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1052/2152] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:59.257622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2ae75-c020-4873-a1f7-fc151fa8c7f2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:59.272984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2ae75-c020-4873-a1f7-fc151fa8c7f2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:59.278924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eaf82-386f-41de-a65c-47e0964bc867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:59.279617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eaf82-386f-41de-a65c-47e0964bc867 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.280230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eaf82-386f-41de-a65c-47e0964bc867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.280510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eaf82-386f-41de-a65c-47e0964bc867 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.281284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481eaf82-386f-41de-a65c-47e0964bc867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:59.281596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481eaf82-386f-41de-a65c-47e0964bc867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:59.283448 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481eaf82-386f-41de-a65c-47e0964bc867 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:59.302869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1101/2153] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:23:59.307491 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d0f7b-d168-453a-aea3-a36f5aedbcc2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:59.319763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d0f7b-d168-453a-aea3-a36f5aedbcc2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:59.325771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9a041-a094-460d-821a-77277edfeb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:59.326431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9a041-a094-460d-821a-77277edfeb65 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.326752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9a041-a094-460d-821a-77277edfeb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.327025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9a041-a094-460d-821a-77277edfeb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.327727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9a041-a094-460d-821a-77277edfeb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:59.329666 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9a041-a094-460d-821a-77277edfeb65 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:59.360190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1053/2154] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:59 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:59.365321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eaf82-386f-41de-a65c-47e0964bc867 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:59.381620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eaf82-386f-41de-a65c-47e0964bc867 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:59.455407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f26e2-5ab7-4ecf-ab84-f31a370ba3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:59.455975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f26e2-5ab7-4ecf-ab84-f31a370ba3cd admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.456258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f26e2-5ab7-4ecf-ab84-f31a370ba3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.456521 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f26e2-5ab7-4ecf-ab84-f31a370ba3cd admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.457230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f26e2-5ab7-4ecf-ab84-f31a370ba3cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:59.459333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f26e2-5ab7-4ecf-ab84-f31a370ba3cd admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:59.485874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1102/2155] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:59 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:59.487553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9a041-a094-460d-821a-77277edfeb65 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:59.498443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9a041-a094-460d-821a-77277edfeb65 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:59.505005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fdd64-35fe-4b30-8265-19ac3b326fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:59.505931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fdd64-35fe-4b30-8265-19ac3b326fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.506325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fdd64-35fe-4b30-8265-19ac3b326fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.506762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fdd64-35fe-4b30-8265-19ac3b326fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.507861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fdd64-35fe-4b30-8265-19ac3b326fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:59.509727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fdd64-35fe-4b30-8265-19ac3b326fd4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:59.520572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1054/2156] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:59.524897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f26e2-5ab7-4ecf-ab84-f31a370ba3cd admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:59.537053 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f26e2-5ab7-4ecf-ab84-f31a370ba3cd admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:59.543218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3499d-424c-4af3-9c6c-61595013f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:59.543913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3499d-424c-4af3-9c6c-61595013f8df admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.544208 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3499d-424c-4af3-9c6c-61595013f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.544491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3499d-424c-4af3-9c6c-61595013f8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.545247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3499d-424c-4af3-9c6c-61595013f8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:59.546928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3499d-424c-4af3-9c6c-61595013f8df admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:59.558076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1103/2157] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:59.562688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fdd64-35fe-4b30-8265-19ac3b326fd4 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:59.573499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fdd64-35fe-4b30-8265-19ac3b326fd4 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:59.579019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5224c-853a-4c5d-8818-f13f9b18efd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:59.579942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5224c-853a-4c5d-8818-f13f9b18efd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.580218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5224c-853a-4c5d-8818-f13f9b18efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.580489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5224c-853a-4c5d-8818-f13f9b18efd3 admin admin] PATH_INFO: `/v3/projects/31525b9819ca4970b5632aec8141aebb/users/c9fa576f903a44168b8ce90bbde1ca8c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.595948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5224c-853a-4c5d-8818-f13f9b18efd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31525b9819ca4970b5632aec8141aebb, user_id=c9fa576f903a44168b8ce90bbde1ca8c, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:59.598676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5224c-853a-4c5d-8818-f13f9b18efd3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:59.613569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1055/2158] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:59 2022] PUT /identity/v3/projects/31525b9819ca4970b5632aec8141aebb/users/c9fa576f903a44168b8ce90bbde1ca8c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:59.624209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808882-4ca9-4583-b7da-d79493394a78 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.624499 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808882-4ca9-4583-b7da-d79493394a78 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.624780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808882-4ca9-4583-b7da-d79493394a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.653862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-4f808882-4ca9-4583-b7da-d79493394a78 None None] MFA Rules not processed for user `c9fa576f903a44168b8ce90bbde1ca8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:59.655754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4f808882-4ca9-4583-b7da-d79493394a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:59.728505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1104/2159] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:59.740283 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5224c-853a-4c5d-8818-f13f9b18efd3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:59.741978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-74e5224c-853a-4c5d-8818-f13f9b18efd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:59.746242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:59.825581 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5224c-853a-4c5d-8818-f13f9b18efd3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:59.830151 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308f11e-c1fd-4f1c-90a3-be059ba9c06e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:59.831138 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f11e-c1fd-4f1c-90a3-be059ba9c06e service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:59.831563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f11e-c1fd-4f1c-90a3-be059ba9c06e service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:59.831971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f11e-c1fd-4f1c-90a3-be059ba9c06e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:59.842539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308f11e-c1fd-4f1c-90a3-be059ba9c06e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:59.844255 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308f11e-c1fd-4f1c-90a3-be059ba9c06e service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:59.854577 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1056/2160] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:09.725375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:09.850010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=34 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:33.241750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808882-4ca9-4583-b7da-d79493394a78 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:33.312546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808882-4ca9-4583-b7da-d79493394a78 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:33.318220 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:33.319275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:33.319464 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:33.319682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] PATH_INFO: `/v3/users/c9fa576f903a44168b8ce90bbde1ca8c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:33.320917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fa576f903a44168b8ce90bbde1ca8c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:33.322998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:33.381701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fa576f903a44168b8ce90bbde1ca8c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:33.382526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fa576f903a44168b8ce90bbde1ca8c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:33.383528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fa576f903a44168b8ce90bbde1ca8c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:33.403397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fa576f903a44168b8ce90bbde1ca8c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:33.413188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fa576f903a44168b8ce90bbde1ca8c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:33.426919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1105/2161] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:24:33 2022] DELETE /identity/v3/users/c9fa576f903a44168b8ce90bbde1ca8c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:33.433059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b4e5a-7232-4d01-a29e-dfb45fc175b7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:33.433574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b4e5a-7232-4d01-a29e-dfb45fc175b7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:33.433690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b4e5a-7232-4d01-a29e-dfb45fc175b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:33.460444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fa6b4e5a-7232-4d01-a29e-dfb45fc175b7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:33.462144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fa6b4e5a-7232-4d01-a29e-dfb45fc175b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:33.537121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1057/2162] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:33.547736 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:33.550097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:33.615552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75d24d-8814-4c02-acd6-7904f545d169 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:33.624995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce06d5-e7c0-4338-9044-50c67b5f87a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:33.625598 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce06d5-e7c0-4338-9044-50c67b5f87a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:33.625886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce06d5-e7c0-4338-9044-50c67b5f87a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:33.626142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce06d5-e7c0-4338-9044-50c67b5f87a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:33.637067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce06d5-e7c0-4338-9044-50c67b5f87a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:33.639374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce06d5-e7c0-4338-9044-50c67b5f87a3 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:33.652111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1106/2163] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:33.940517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b4e5a-7232-4d01-a29e-dfb45fc175b7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:33.942083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fa6b4e5a-7232-4d01-a29e-dfb45fc175b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:33.954686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b4e5a-7232-4d01-a29e-dfb45fc175b7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:33.960370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:33.961324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:33.961611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:33.961887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] PATH_INFO: `/v3/projects/31525b9819ca4970b5632aec8141aebb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:33.967392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31525b9819ca4970b5632aec8141aebb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:33.969510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:34.016978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31525b9819ca4970b5632aec8141aebb', 'request_id': 'req-c498267e-88b8-47ea-9df2-579d8c26a487'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:34.022441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31525b9819ca4970b5632aec8141aebb', 'request_id': 'req-c498267e-88b8-47ea-9df2-579d8c26a487'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:34.031256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31525b9819ca4970b5632aec8141aebb', 'request_id': 'req-c498267e-88b8-47ea-9df2-579d8c26a487'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:34.042943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] The token cache is being invalidate because project 31525b9819ca4970b5632aec8141aebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:24:34.043236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:34.043922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c498267e-88b8-47ea-9df2-579d8c26a487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:34.045532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1058/2164] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:24:33 2022] DELETE /identity/v3/projects/31525b9819ca4970b5632aec8141aebb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:34.050457 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d36a1-c2db-41bf-a2f7-30340ba69c9b None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:34.050773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d36a1-c2db-41bf-a2f7-30340ba69c9b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:34.051054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d36a1-c2db-41bf-a2f7-30340ba69c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:34.069228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-745d36a1-c2db-41bf-a2f7-30340ba69c9b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:34.070483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-745d36a1-c2db-41bf-a2f7-30340ba69c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:34.089614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:34.138226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1107/2165] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:34.147439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573e82-9dbf-4dff-872c-d5ba9ed6f9c1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:34.147732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573e82-9dbf-4dff-872c-d5ba9ed6f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:34.148019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573e82-9dbf-4dff-872c-d5ba9ed6f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:34.167918 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-cf573e82-9dbf-4dff-872c-d5ba9ed6f9c1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:34.169143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cf573e82-9dbf-4dff-872c-d5ba9ed6f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:34.178431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1059/2166] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:34.183545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d36a1-c2db-41bf-a2f7-30340ba69c9b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:34.198525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d36a1-c2db-41bf-a2f7-30340ba69c9b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:34.204811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bf193-b8da-40c8-b9cd-612d2b0cd8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:34.205479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bf193-b8da-40c8-b9cd-612d2b0cd8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:34.205768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bf193-b8da-40c8-b9cd-612d2b0cd8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:34.206038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bf193-b8da-40c8-b9cd-612d2b0cd8ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:34.206811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bf193-b8da-40c8-b9cd-612d2b0cd8ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:24:34.207116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bf193-b8da-40c8-b9cd-612d2b0cd8ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:34.208787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bf193-b8da-40c8-b9cd-612d2b0cd8ff admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:34.222249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1108/2167] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:24:34.226486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf573e82-9dbf-4dff-872c-d5ba9ed6f9c1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:34.236096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf573e82-9dbf-4dff-872c-d5ba9ed6f9c1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:34.241142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362db8c-d7f4-4271-b04d-40cbbf1f78aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:34.241801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362db8c-d7f4-4271-b04d-40cbbf1f78aa admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:34.242084 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362db8c-d7f4-4271-b04d-40cbbf1f78aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:34.242361 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362db8c-d7f4-4271-b04d-40cbbf1f78aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:34.243113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362db8c-d7f4-4271-b04d-40cbbf1f78aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:34.245190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362db8c-d7f4-4271-b04d-40cbbf1f78aa admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:34.272286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1060/2168] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:24:34 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:24:34.276583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bf193-b8da-40c8-b9cd-612d2b0cd8ff admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:34.287809 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bf193-b8da-40c8-b9cd-612d2b0cd8ff admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:34.347078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f7158-6e4e-4ebe-a76b-86f60c9d5d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:34.347764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f7158-6e4e-4ebe-a76b-86f60c9d5d66 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:34.348052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f7158-6e4e-4ebe-a76b-86f60c9d5d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:34.348330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f7158-6e4e-4ebe-a76b-86f60c9d5d66 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:34.349052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f7158-6e4e-4ebe-a76b-86f60c9d5d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:34.351102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f7158-6e4e-4ebe-a76b-86f60c9d5d66 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:34.377195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1109/2169] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:24:34 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:24:34.382180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362db8c-d7f4-4271-b04d-40cbbf1f78aa admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:34.393337 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362db8c-d7f4-4271-b04d-40cbbf1f78aa admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:34.399506 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854c8fe-a63c-49b5-91d6-b9181ae84add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:34.400291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c8fe-a63c-49b5-91d6-b9181ae84add admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:34.400576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c8fe-a63c-49b5-91d6-b9181ae84add admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:34.400853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c8fe-a63c-49b5-91d6-b9181ae84add admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:34.401596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854c8fe-a63c-49b5-91d6-b9181ae84add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:34.403312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854c8fe-a63c-49b5-91d6-b9181ae84add admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:34.414944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1061/2170] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:24:34.419200 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f7158-6e4e-4ebe-a76b-86f60c9d5d66 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:34.429681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f7158-6e4e-4ebe-a76b-86f60c9d5d66 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:34.435741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fe447-3759-415d-97b7-c2b38486a6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:34.436336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fe447-3759-415d-97b7-c2b38486a6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:34.436624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fe447-3759-415d-97b7-c2b38486a6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:34.436887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fe447-3759-415d-97b7-c2b38486a6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:34.437636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fe447-3759-415d-97b7-c2b38486a6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:34.439300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fe447-3759-415d-97b7-c2b38486a6b8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:34.449638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1110/2171] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:24:34.453894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854c8fe-a63c-49b5-91d6-b9181ae84add admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:34.464271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854c8fe-a63c-49b5-91d6-b9181ae84add admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:34.469487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a87323-03ce-46e5-8989-db532e6dcb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:34.470373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a87323-03ce-46e5-8989-db532e6dcb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:34.470705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a87323-03ce-46e5-8989-db532e6dcb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:34.470985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a87323-03ce-46e5-8989-db532e6dcb01 admin admin] PATH_INFO: `/v3/projects/d2e59e9a35fc420e8fe7a1a228e1bac7/users/cd8402503d5e48018a6e837283ac41f6/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:34.487377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a87323-03ce-46e5-8989-db532e6dcb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e59e9a35fc420e8fe7a1a228e1bac7, user_id=cd8402503d5e48018a6e837283ac41f6, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:34.490045 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a87323-03ce-46e5-8989-db532e6dcb01 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:34.504981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1062/2172] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:24:34 2022] PUT /identity/v3/projects/d2e59e9a35fc420e8fe7a1a228e1bac7/users/cd8402503d5e48018a6e837283ac41f6/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:34.515154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a314-28c7-4769-a6ef-03f15fe00c6f None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:34.515447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a314-28c7-4769-a6ef-03f15fe00c6f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:34.515728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a314-28c7-4769-a6ef-03f15fe00c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:34.543609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e6c1a314-28c7-4769-a6ef-03f15fe00c6f None None] MFA Rules not processed for user `cd8402503d5e48018a6e837283ac41f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:34.544840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e6c1a314-28c7-4769-a6ef-03f15fe00c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:34.613923 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1111/2173] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:34.628376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a87323-03ce-46e5-8989-db532e6dcb01 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:34.630979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c8a87323-03ce-46e5-8989-db532e6dcb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:34.656348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:34.692638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a87323-03ce-46e5-8989-db532e6dcb01 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:34.696445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bac1a7-c79e-471e-88f2-7cdd68130ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:34.697128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bac1a7-c79e-471e-88f2-7cdd68130ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:34.697429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bac1a7-c79e-471e-88f2-7cdd68130ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:34.697697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bac1a7-c79e-471e-88f2-7cdd68130ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:34.706293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bac1a7-c79e-471e-88f2-7cdd68130ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:34.707762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bac1a7-c79e-471e-88f2-7cdd68130ed4 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:34.716632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1063/2174] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:44.610988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:44.712670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=17 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:55.094304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a314-28c7-4769-a6ef-03f15fe00c6f None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:55.183336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a314-28c7-4769-a6ef-03f15fe00c6f None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:55.192038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:55.193145 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:55.193584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:55.193934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] PATH_INFO: `/v3/users/cd8402503d5e48018a6e837283ac41f6` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:55.195225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8402503d5e48018a6e837283ac41f6)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:55.197192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:55.249199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8402503d5e48018a6e837283ac41f6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:55.249889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8402503d5e48018a6e837283ac41f6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:55.250528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8402503d5e48018a6e837283ac41f6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:55.263261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8402503d5e48018a6e837283ac41f6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:55.271840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8402503d5e48018a6e837283ac41f6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:55.285564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1112/2175] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:24:55 2022] DELETE /identity/v3/users/cd8402503d5e48018a6e837283ac41f6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:55.290252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448700ac-1ee8-4b00-81b5-c0694ee7df3f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:55.290795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448700ac-1ee8-4b00-81b5-c0694ee7df3f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:55.290891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448700ac-1ee8-4b00-81b5-c0694ee7df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:55.311284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-448700ac-1ee8-4b00-81b5-c0694ee7df3f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:55.312613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-448700ac-1ee8-4b00-81b5-c0694ee7df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:55.381588 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1064/2176] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:55.391575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:55.393205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:55.457328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45e0a7-2a60-4ea4-9d55-9e08c7e182e9 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:55.461084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb6a2-bc58-4e8c-8bf6-b2e7d94e857b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:55.461744 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb6a2-bc58-4e8c-8bf6-b2e7d94e857b service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:55.462028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb6a2-bc58-4e8c-8bf6-b2e7d94e857b service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:55.462298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb6a2-bc58-4e8c-8bf6-b2e7d94e857b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:55.472254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cb6a2-bc58-4e8c-8bf6-b2e7d94e857b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:55.473726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cb6a2-bc58-4e8c-8bf6-b2e7d94e857b service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:55.483764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1113/2177] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:55.763388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448700ac-1ee8-4b00-81b5-c0694ee7df3f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:55.764894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-448700ac-1ee8-4b00-81b5-c0694ee7df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:55.778520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448700ac-1ee8-4b00-81b5-c0694ee7df3f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:55.786586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:55.787496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:55.787811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:55.788083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] PATH_INFO: `/v3/projects/d2e59e9a35fc420e8fe7a1a228e1bac7` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:55.789368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e59e9a35fc420e8fe7a1a228e1bac7)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:55.791340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:55.844950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e59e9a35fc420e8fe7a1a228e1bac7', 'request_id': 'req-5bb6a352-1b86-40ec-87ef-9b64c6a892be'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:55.851143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e59e9a35fc420e8fe7a1a228e1bac7', 'request_id': 'req-5bb6a352-1b86-40ec-87ef-9b64c6a892be'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:55.862173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e59e9a35fc420e8fe7a1a228e1bac7', 'request_id': 'req-5bb6a352-1b86-40ec-87ef-9b64c6a892be'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:55.875015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] The token cache is being invalidate because project d2e59e9a35fc420e8fe7a1a228e1bac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:24:55.875292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:55.875931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5bb6a352-1b86-40ec-87ef-9b64c6a892be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:55.877504 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1065/2178] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:24:55 2022] DELETE /identity/v3/projects/d2e59e9a35fc420e8fe7a1a228e1bac7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:55.882591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb685-44c5-4e71-ae8b-64158396eeda None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:55.882885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb685-44c5-4e71-ae8b-64158396eeda None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:55.883170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb685-44c5-4e71-ae8b-64158396eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:55.902435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-f8edb685-44c5-4e71-ae8b-64158396eeda None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:55.903701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f8edb685-44c5-4e71-ae8b-64158396eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:55.923508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:55.980200 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1114/2179] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:55.988541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4608ef9-77ea-4924-8745-5c23ab0e3ab3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:55.988832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4608ef9-77ea-4924-8745-5c23ab0e3ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:55.989109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4608ef9-77ea-4924-8745-5c23ab0e3ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:56.009201 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c4608ef9-77ea-4924-8745-5c23ab0e3ab3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:56.010333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c4608ef9-77ea-4924-8745-5c23ab0e3ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:56.019529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1066/2180] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:56.024121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edb685-44c5-4e71-ae8b-64158396eeda None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:56.034749 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edb685-44c5-4e71-ae8b-64158396eeda None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:56.039940 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af870d-6241-4e02-908f-c19dd27e4bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:56.040591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af870d-6241-4e02-908f-c19dd27e4bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:56.040851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af870d-6241-4e02-908f-c19dd27e4bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:56.041147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af870d-6241-4e02-908f-c19dd27e4bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:56.041873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af870d-6241-4e02-908f-c19dd27e4bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:24:56.042176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af870d-6241-4e02-908f-c19dd27e4bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:56.043829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af870d-6241-4e02-908f-c19dd27e4bb8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:56.055426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1115/2181] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:24:56.059936 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4608ef9-77ea-4924-8745-5c23ab0e3ab3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:56.069112 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4608ef9-77ea-4924-8745-5c23ab0e3ab3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:56.074673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace343ec-a380-4d90-b413-a54def2b5dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:56.075452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace343ec-a380-4d90-b413-a54def2b5dca admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:56.075738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace343ec-a380-4d90-b413-a54def2b5dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:56.076013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace343ec-a380-4d90-b413-a54def2b5dca admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:56.076705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace343ec-a380-4d90-b413-a54def2b5dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:56.078726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace343ec-a380-4d90-b413-a54def2b5dca admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:56.118597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1067/2182] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:24:56 2022] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:24:56.120367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af870d-6241-4e02-908f-c19dd27e4bb8 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:56.134765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af870d-6241-4e02-908f-c19dd27e4bb8 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:56.202410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343d158-b815-43b6-972a-cb7865bb4f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:56.203129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d158-b815-43b6-972a-cb7865bb4f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:56.203415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d158-b815-43b6-972a-cb7865bb4f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:56.203698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d158-b815-43b6-972a-cb7865bb4f91 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:56.204402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343d158-b815-43b6-972a-cb7865bb4f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:56.206366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343d158-b815-43b6-972a-cb7865bb4f91 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:56.227481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1116/2183] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:24:56 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:24:56.231740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace343ec-a380-4d90-b413-a54def2b5dca admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:56.242047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace343ec-a380-4d90-b413-a54def2b5dca admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:56.247129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b40ee-4bd7-4905-ab41-cce721bc08de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:56.247836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b40ee-4bd7-4905-ab41-cce721bc08de admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:56.248115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b40ee-4bd7-4905-ab41-cce721bc08de admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:56.248388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b40ee-4bd7-4905-ab41-cce721bc08de admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:56.249135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b40ee-4bd7-4905-ab41-cce721bc08de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:56.250780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b40ee-4bd7-4905-ab41-cce721bc08de admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:56.261291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1068/2184] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:24:56.265300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343d158-b815-43b6-972a-cb7865bb4f91 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:56.276809 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343d158-b815-43b6-972a-cb7865bb4f91 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:56.283449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7026f4-7d47-461d-9bfd-392d8d294409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:56.284125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7026f4-7d47-461d-9bfd-392d8d294409 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:56.284409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7026f4-7d47-461d-9bfd-392d8d294409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:56.284672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7026f4-7d47-461d-9bfd-392d8d294409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:56.285415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7026f4-7d47-461d-9bfd-392d8d294409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:56.287081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7026f4-7d47-461d-9bfd-392d8d294409 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:56.298426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1117/2185] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:24:56.303540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b40ee-4bd7-4905-ab41-cce721bc08de admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:56.317328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b40ee-4bd7-4905-ab41-cce721bc08de admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:56.324347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772e981-c7af-4a33-9463-2d89306f125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:56.325563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e981-c7af-4a33-9463-2d89306f125c admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:56.325916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e981-c7af-4a33-9463-2d89306f125c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:56.326277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e981-c7af-4a33-9463-2d89306f125c admin admin] PATH_INFO: `/v3/projects/b763a4ff86c2403090a8e0801802ac3b/users/44b28ba7aa4845179b770f5865e8024e/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:56.345086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772e981-c7af-4a33-9463-2d89306f125c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b763a4ff86c2403090a8e0801802ac3b, user_id=44b28ba7aa4845179b770f5865e8024e, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:56.347820 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772e981-c7af-4a33-9463-2d89306f125c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:56.363130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1069/2186] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:24:56 2022] PUT /identity/v3/projects/b763a4ff86c2403090a8e0801802ac3b/users/44b28ba7aa4845179b770f5865e8024e/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:56.377869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aad4f-e5e8-46d3-b74d-00cb198cc77d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:56.378164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aad4f-e5e8-46d3-b74d-00cb198cc77d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:56.378446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aad4f-e5e8-46d3-b74d-00cb198cc77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:56.410759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-481aad4f-e5e8-46d3-b74d-00cb198cc77d None None] MFA Rules not processed for user `44b28ba7aa4845179b770f5865e8024e`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:56.411977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-481aad4f-e5e8-46d3-b74d-00cb198cc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:56.484646 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1118/2187] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:56.502406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772e981-c7af-4a33-9463-2d89306f125c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:56.504222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a772e981-c7af-4a33-9463-2d89306f125c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:56.527191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:56.564542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772e981-c7af-4a33-9463-2d89306f125c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:56.568275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db2731-6140-4249-a628-0d11a975e81f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:56.568967 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db2731-6140-4249-a628-0d11a975e81f service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:56.569247 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db2731-6140-4249-a628-0d11a975e81f service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:56.569538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db2731-6140-4249-a628-0d11a975e81f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:56.578120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db2731-6140-4249-a628-0d11a975e81f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:56.579589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db2731-6140-4249-a628-0d11a975e81f service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:56.588893 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1070/2188] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:57.531684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aad4f-e5e8-46d3-b74d-00cb198cc77d None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:57.533932 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-481aad4f-e5e8-46d3-b74d-00cb198cc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:57.562245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:57.619693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aad4f-e5e8-46d3-b74d-00cb198cc77d None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:57.626972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:57.627905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:57.628189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:57.628467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] PATH_INFO: `/v3/users/5d716ed903c44d00930b841605fe1750` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:57.629836 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d716ed903c44d00930b841605fe1750)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:57.631970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:57.685901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d716ed903c44d00930b841605fe1750'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:57.686578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d716ed903c44d00930b841605fe1750'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:57.687214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d716ed903c44d00930b841605fe1750'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:57.699480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d716ed903c44d00930b841605fe1750'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:57.708430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d716ed903c44d00930b841605fe1750'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:57.724363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1119/2189] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:24:57 2022] DELETE /identity/v3/users/5d716ed903c44d00930b841605fe1750 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:57.729161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa42fa-18df-4e4f-b721-e00df8434d7c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:57.729645 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa42fa-18df-4e4f-b721-e00df8434d7c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:57.729771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa42fa-18df-4e4f-b721-e00df8434d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:57.747958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-24fa42fa-18df-4e4f-b721-e00df8434d7c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:57.749157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-24fa42fa-18df-4e4f-b721-e00df8434d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:57.819931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1071/2190] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:57.831072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:57.833161 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:57.899761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b5925-ba76-4c92-b111-b089965bedcb admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:57.904151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fde59-a2af-417b-87f9-f274947d3900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:57.905130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fde59-a2af-417b-87f9-f274947d3900 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:57.905414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fde59-a2af-417b-87f9-f274947d3900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:57.905701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fde59-a2af-417b-87f9-f274947d3900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:57.915529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fde59-a2af-417b-87f9-f274947d3900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:57.917011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fde59-a2af-417b-87f9-f274947d3900 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:57.928325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1120/2191] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:58.217563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa42fa-18df-4e4f-b721-e00df8434d7c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:58.219791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-24fa42fa-18df-4e4f-b721-e00df8434d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:58.232475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa42fa-18df-4e4f-b721-e00df8434d7c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:58.238466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:58.239580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:58.239995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:58.240381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] PATH_INFO: `/v3/projects/c25e584bdfe9402c8c4ecc409fbf9b83` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:58.241832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25e584bdfe9402c8c4ecc409fbf9b83)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:58.243889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:58.292637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25e584bdfe9402c8c4ecc409fbf9b83', 'request_id': 'req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:58.298252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25e584bdfe9402c8c4ecc409fbf9b83', 'request_id': 'req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:58.307515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25e584bdfe9402c8c4ecc409fbf9b83', 'request_id': 'req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:58.322855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] The token cache is being invalidate because project c25e584bdfe9402c8c4ecc409fbf9b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:24:58.323299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:58.324046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d58cce0-4690-4ae1-9c9a-c07cce54a5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:58.325776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1072/2192] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:24:58 2022] DELETE /identity/v3/projects/c25e584bdfe9402c8c4ecc409fbf9b83 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:58.331304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f804-af92-4844-a6ef-417fb93783ca None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:58.331535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f804-af92-4844-a6ef-417fb93783ca None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:58.331885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f804-af92-4844-a6ef-417fb93783ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:58.350482 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9ce9f804-af92-4844-a6ef-417fb93783ca None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:58.351883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9ce9f804-af92-4844-a6ef-417fb93783ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:58.388629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:58.429710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1121/2193] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:58.437714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc727a-f37f-49c1-9c7e-4f74f819713e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:58.438008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc727a-f37f-49c1-9c7e-4f74f819713e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:58.438300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc727a-f37f-49c1-9c7e-4f74f819713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:58.457224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-38fc727a-f37f-49c1-9c7e-4f74f819713e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:58.458439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-38fc727a-f37f-49c1-9c7e-4f74f819713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:58.467475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1073/2194] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:24:58.471909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9f804-af92-4844-a6ef-417fb93783ca None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:58.482045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9f804-af92-4844-a6ef-417fb93783ca None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:58.487659 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8afac6-7821-4462-bd38-ef79cfee1843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:58.488575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8afac6-7821-4462-bd38-ef79cfee1843 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:58.488855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8afac6-7821-4462-bd38-ef79cfee1843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:58.489133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8afac6-7821-4462-bd38-ef79cfee1843 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:58.489865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8afac6-7821-4462-bd38-ef79cfee1843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:24:58.490171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8afac6-7821-4462-bd38-ef79cfee1843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:58.491858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8afac6-7821-4462-bd38-ef79cfee1843 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:58.504069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1122/2195] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:24:58.509230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc727a-f37f-49c1-9c7e-4f74f819713e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:58.523300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc727a-f37f-49c1-9c7e-4f74f819713e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:58.529946 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526489fd-dbc0-4723-a8f1-8011ba76bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:58.531001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526489fd-dbc0-4723-a8f1-8011ba76bd1d admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:58.531425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526489fd-dbc0-4723-a8f1-8011ba76bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:58.531666 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526489fd-dbc0-4723-a8f1-8011ba76bd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:58.532760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526489fd-dbc0-4723-a8f1-8011ba76bd1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:58.535833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526489fd-dbc0-4723-a8f1-8011ba76bd1d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:58.569870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1074/2196] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:24:58 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:24:58.574601 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8afac6-7821-4462-bd38-ef79cfee1843 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:58.591264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8afac6-7821-4462-bd38-ef79cfee1843 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:58.659315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c489b-11f8-4ee5-8b00-823a2be9e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:58.659991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c489b-11f8-4ee5-8b00-823a2be9e281 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:58.660279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c489b-11f8-4ee5-8b00-823a2be9e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:58.660553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c489b-11f8-4ee5-8b00-823a2be9e281 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:58.661253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c489b-11f8-4ee5-8b00-823a2be9e281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:58.663328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c489b-11f8-4ee5-8b00-823a2be9e281 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:58.688430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1123/2197] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:24:58 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:24:58.692160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526489fd-dbc0-4723-a8f1-8011ba76bd1d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:58.706247 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526489fd-dbc0-4723-a8f1-8011ba76bd1d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:58.714259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389dfd5-1b68-487a-b56f-69fea1504ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:58.714998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389dfd5-1b68-487a-b56f-69fea1504ced admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:58.715318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389dfd5-1b68-487a-b56f-69fea1504ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:58.715651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389dfd5-1b68-487a-b56f-69fea1504ced admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:58.716662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389dfd5-1b68-487a-b56f-69fea1504ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:58.719571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389dfd5-1b68-487a-b56f-69fea1504ced admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:58.741461 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1075/2198] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:24:58.745745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c489b-11f8-4ee5-8b00-823a2be9e281 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:58.759274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c489b-11f8-4ee5-8b00-823a2be9e281 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:58.764706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972a6ba-dd5b-4bce-9c48-447b13d5ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:58.765382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972a6ba-dd5b-4bce-9c48-447b13d5ce74 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:58.765691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972a6ba-dd5b-4bce-9c48-447b13d5ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:58.765944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972a6ba-dd5b-4bce-9c48-447b13d5ce74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:58.766964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972a6ba-dd5b-4bce-9c48-447b13d5ce74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:58.769328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972a6ba-dd5b-4bce-9c48-447b13d5ce74 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:58.782283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1124/2199] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:24:58.786933 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389dfd5-1b68-487a-b56f-69fea1504ced admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:58.799390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389dfd5-1b68-487a-b56f-69fea1504ced admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:58.805243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f525cb-b75d-43e6-89b6-e5d44181bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:58.806144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f525cb-b75d-43e6-89b6-e5d44181bb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:58.806430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f525cb-b75d-43e6-89b6-e5d44181bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:58.806769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f525cb-b75d-43e6-89b6-e5d44181bb2f admin admin] PATH_INFO: `/v3/projects/bab672cf7d354ccabfab45f183034783/users/ebc84d16531b4b319df07a06ddb69833/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:58.809309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:58.829512 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f525cb-b75d-43e6-89b6-e5d44181bb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab672cf7d354ccabfab45f183034783, user_id=ebc84d16531b4b319df07a06ddb69833, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:58.832260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f525cb-b75d-43e6-89b6-e5d44181bb2f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:58.848740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1076/2200] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:24:58 2022] PUT /identity/v3/projects/bab672cf7d354ccabfab45f183034783/users/ebc84d16531b4b319df07a06ddb69833/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:58.859490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e965d7-1753-42f5-b436-832b9b0dc6fd None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:58.859808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e965d7-1753-42f5-b436-832b9b0dc6fd None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:58.860097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e965d7-1753-42f5-b436-832b9b0dc6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:58.893028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d2e965d7-1753-42f5-b436-832b9b0dc6fd None None] MFA Rules not processed for user `ebc84d16531b4b319df07a06ddb69833`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:58.894779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d2e965d7-1753-42f5-b436-832b9b0dc6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:58.970431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1125/2201] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:58.985751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f525cb-b75d-43e6-89b6-e5d44181bb2f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:58.988738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d9f525cb-b75d-43e6-89b6-e5d44181bb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:59.063103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f525cb-b75d-43e6-89b6-e5d44181bb2f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:59.067166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a8d18-bc35-4e68-af88-a29e6f47e581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:59.067863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a8d18-bc35-4e68-af88-a29e6f47e581 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:59.068148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a8d18-bc35-4e68-af88-a29e6f47e581 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:59.068422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a8d18-bc35-4e68-af88-a29e6f47e581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:59.081464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a8d18-bc35-4e68-af88-a29e6f47e581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:59.084984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a8d18-bc35-4e68-af88-a29e6f47e581 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:59.094476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1077/2202] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:05.886197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e965d7-1753-42f5-b436-832b9b0dc6fd None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:05.887828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d2e965d7-1753-42f5-b436-832b9b0dc6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:05.930799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:05.958639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e965d7-1753-42f5-b436-832b9b0dc6fd None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:05.963815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:05.964712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:05.964991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:05.965260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] PATH_INFO: `/v3/users/44b28ba7aa4845179b770f5865e8024e` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:05.966517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b28ba7aa4845179b770f5865e8024e)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:05.968566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:06.026112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b28ba7aa4845179b770f5865e8024e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:06.027419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b28ba7aa4845179b770f5865e8024e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:06.028341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b28ba7aa4845179b770f5865e8024e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:06.043153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b28ba7aa4845179b770f5865e8024e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:06.051831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b28ba7aa4845179b770f5865e8024e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:06.065508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1126/2203] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:25:05 2022] DELETE /identity/v3/users/44b28ba7aa4845179b770f5865e8024e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:25:06.070551 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f407b-a2a0-43f7-a3e7-581e397faeb4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:06.071074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f407b-a2a0-43f7-a3e7-581e397faeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:06.071179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f407b-a2a0-43f7-a3e7-581e397faeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:06.089260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bc3f407b-a2a0-43f7-a3e7-581e397faeb4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:25:06.090547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bc3f407b-a2a0-43f7-a3e7-581e397faeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:06.156262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1078/2204] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:25:06.166401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:06.168198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:06.232510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7241e0c-2dc7-4ae8-9c27-30ae24b0ab3e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:06.236195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185729db-b638-4187-bd63-7c09437fe2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:06.236859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185729db-b638-4187-bd63-7c09437fe2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:06.237141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185729db-b638-4187-bd63-7c09437fe2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:06.237415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185729db-b638-4187-bd63-7c09437fe2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:06.246761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185729db-b638-4187-bd63-7c09437fe2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:06.248216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185729db-b638-4187-bd63-7c09437fe2d1 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:06.257644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1127/2205] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:25:06.541244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f407b-a2a0-43f7-a3e7-581e397faeb4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:06.542838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bc3f407b-a2a0-43f7-a3e7-581e397faeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:06.555867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f407b-a2a0-43f7-a3e7-581e397faeb4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:06.561036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:06.561920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:06.562214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:06.562515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] PATH_INFO: `/v3/projects/b763a4ff86c2403090a8e0801802ac3b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:06.563786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b763a4ff86c2403090a8e0801802ac3b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:06.565739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:06.616647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b763a4ff86c2403090a8e0801802ac3b', 'request_id': 'req-155cab5e-d49b-4735-9db6-699a62c0cc70'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:06.622723 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b763a4ff86c2403090a8e0801802ac3b', 'request_id': 'req-155cab5e-d49b-4735-9db6-699a62c0cc70'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:06.632468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b763a4ff86c2403090a8e0801802ac3b', 'request_id': 'req-155cab5e-d49b-4735-9db6-699a62c0cc70'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:06.644422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] The token cache is being invalidate because project b763a4ff86c2403090a8e0801802ac3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:25:06.644717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:06.645374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-155cab5e-d49b-4735-9db6-699a62c0cc70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:06.647095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1079/2206] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:25:06 2022] DELETE /identity/v3/projects/b763a4ff86c2403090a8e0801802ac3b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:25:16.253511 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:16.641347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:27.931894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185729db-b638-4187-bd63-7c09437fe2d1 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:27.933503 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-185729db-b638-4187-bd63-7c09437fe2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:27.947562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185729db-b638-4187-bd63-7c09437fe2d1 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:28.008665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:28.009554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:28.009838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:28.010139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] PATH_INFO: `/v3/users/ebc84d16531b4b319df07a06ddb69833` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:28.011401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc84d16531b4b319df07a06ddb69833)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:28.013491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:28.070020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc84d16531b4b319df07a06ddb69833'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:28.070758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc84d16531b4b319df07a06ddb69833'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:28.071388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc84d16531b4b319df07a06ddb69833'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:28.084406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc84d16531b4b319df07a06ddb69833'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:28.094114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc84d16531b4b319df07a06ddb69833'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:28.108126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1128/2207] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:25:27 2022] DELETE /identity/v3/users/ebc84d16531b4b319df07a06ddb69833 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:25:28.112946 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcdf79-10ff-43f0-955e-25296aa149e6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:28.113446 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcdf79-10ff-43f0-955e-25296aa149e6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:28.113544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcdf79-10ff-43f0-955e-25296aa149e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:28.132833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-88bcdf79-10ff-43f0-955e-25296aa149e6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:25:28.134128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-88bcdf79-10ff-43f0-955e-25296aa149e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:28.208872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1080/2208] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:25:28.217138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:28.218752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:28.281947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc71ce-f807-4a36-b018-506264a34c83 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:28.286256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6c4b-ff1e-4108-ab37-bed70cb77eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:28.287395 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6c4b-ff1e-4108-ab37-bed70cb77eba service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:28.287818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6c4b-ff1e-4108-ab37-bed70cb77eba service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:28.288128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6c4b-ff1e-4108-ab37-bed70cb77eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:28.297997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e6c4b-ff1e-4108-ab37-bed70cb77eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:28.299749 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e6c4b-ff1e-4108-ab37-bed70cb77eba service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:28.310007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1129/2209] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:25:28.603551 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcdf79-10ff-43f0-955e-25296aa149e6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:28.615567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-88bcdf79-10ff-43f0-955e-25296aa149e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:28.634316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcdf79-10ff-43f0-955e-25296aa149e6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:28.639650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:28.640555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:28.640837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:28.641113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] PATH_INFO: `/v3/projects/bab672cf7d354ccabfab45f183034783` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:28.642408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab672cf7d354ccabfab45f183034783)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:28.645032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:28.706445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab672cf7d354ccabfab45f183034783', 'request_id': 'req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:28.712890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab672cf7d354ccabfab45f183034783', 'request_id': 'req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:28.722158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab672cf7d354ccabfab45f183034783', 'request_id': 'req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:28.734069 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] The token cache is being invalidate because project bab672cf7d354ccabfab45f183034783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:25:28.734208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:28.734938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:25:28.736516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1081/2210] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:25:28 2022] DELETE /identity/v3/projects/bab672cf7d354ccabfab45f183034783 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:25:31.886547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6c4b-ff1e-4108-ab37-bed70cb77eba service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:31.896172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6c4b-ff1e-4108-ab37-bed70cb77eba service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:31.917303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:31.950349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be57a72-6349-462d-95fc-5e9f2957c761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:31.951033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be57a72-6349-462d-95fc-5e9f2957c761 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:31.951282 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be57a72-6349-462d-95fc-5e9f2957c761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:31.951568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be57a72-6349-462d-95fc-5e9f2957c761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:31.953612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3be57a72-6349-462d-95fc-5e9f2957c761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:32.042865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be57a72-6349-462d-95fc-5e9f2957c761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:32.045057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be57a72-6349-462d-95fc-5e9f2957c761 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:32.073990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1130/2211] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:32.122069 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:32.123673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:32.136419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54abcc-ca96-40a2-8b58-df2ddc5048ee admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:32.140406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f8218-81f9-457e-825c-dac5133a3c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:32.141061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f8218-81f9-457e-825c-dac5133a3c99 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:32.141367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f8218-81f9-457e-825c-dac5133a3c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:32.141646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f8218-81f9-457e-825c-dac5133a3c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:32.143586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-207f8218-81f9-457e-825c-dac5133a3c99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:32.157885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f8218-81f9-457e-825c-dac5133a3c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:32.159350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f8218-81f9-457e-825c-dac5133a3c99 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:32.170462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1082/2212] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:37.386892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889bff-8182-4811-b76f-e6664c5361ab None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:37.387444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889bff-8182-4811-b76f-e6664c5361ab None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:37.387444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889bff-8182-4811-b76f-e6664c5361ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:37.414278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-55889bff-8182-4811-b76f-e6664c5361ab None None] MFA Rules not processed for user `da80b9a52feb462faf0469f2ab701fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:25:37.416184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-55889bff-8182-4811-b76f-e6664c5361ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:37.476525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1131/2213] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:25:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:25:40.187591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ddfa5-6f96-4bc9-aa39-f57defadac32 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:40.188116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ddfa5-6f96-4bc9-aa39-f57defadac32 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:40.188198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ddfa5-6f96-4bc9-aa39-f57defadac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:40.207635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4e4ddfa5-6f96-4bc9-aa39-f57defadac32 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:25:40.209237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4e4ddfa5-6f96-4bc9-aa39-f57defadac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:40.274714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1083/2214] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:25:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:25:40.322151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55889bff-8182-4811-b76f-e6664c5361ab None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:40.323638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-55889bff-8182-4811-b76f-e6664c5361ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:40.397116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:40.437741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55889bff-8182-4811-b76f-e6664c5361ab None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:40.445381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36133-3828-41e6-bbb0-b1d1fcbcdec4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:40.446067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36133-3828-41e6-bbb0-b1d1fcbcdec4 service swift] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:40.446396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36133-3828-41e6-bbb0-b1d1fcbcdec4 service swift] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:40.446719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36133-3828-41e6-bbb0-b1d1fcbcdec4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:40.457359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f36133-3828-41e6-bbb0-b1d1fcbcdec4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:40.458478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f36133-3828-41e6-bbb0-b1d1fcbcdec4 service swift] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:40.470462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1132/2215] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:25:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:25:45.972662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ddfa5-6f96-4bc9-aa39-f57defadac32 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:45.983973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ddfa5-6f96-4bc9-aa39-f57defadac32 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:45.988765 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5946fc-6a14-4d95-a648-76cf5e1ea0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:45.989625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5946fc-6a14-4d95-a648-76cf5e1ea0fe service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:45.990070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5946fc-6a14-4d95-a648-76cf5e1ea0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:45.990365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5946fc-6a14-4d95-a648-76cf5e1ea0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:45.993097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6f5946fc-6a14-4d95-a648-76cf5e1ea0fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:46.011110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:46.088635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5946fc-6a14-4d95-a648-76cf5e1ea0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:46.090118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5946fc-6a14-4d95-a648-76cf5e1ea0fe service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:46.102040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1084/2216] 10.222.0.66 () {60 vars in 1396 bytes} [Wed Jun 22 10:25:45 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:50.466944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=15 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:51.879872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36133-3828-41e6-bbb0-b1d1fcbcdec4 service swift] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:51.881521 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-90f36133-3828-41e6-bbb0-b1d1fcbcdec4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:51.899110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36133-3828-41e6-bbb0-b1d1fcbcdec4 service swift] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:51.906068 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ef5f8-16a0-4716-ba2e-f2f8d6e3408e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:51.906758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef5f8-16a0-4716-ba2e-f2f8d6e3408e service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:51.907042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef5f8-16a0-4716-ba2e-f2f8d6e3408e service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:51.907397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef5f8-16a0-4716-ba2e-f2f8d6e3408e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:51.909534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cb9ef5f8-16a0-4716-ba2e-f2f8d6e3408e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:51.921977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ef5f8-16a0-4716-ba2e-f2f8d6e3408e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:51.923624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ef5f8-16a0-4716-ba2e-f2f8d6e3408e service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:51.934068 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1133/2217] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:56.095756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=21 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:57.882007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5946fc-6a14-4d95-a648-76cf5e1ea0fe service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:57.894768 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5946fc-6a14-4d95-a648-76cf5e1ea0fe service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:57.899097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5df01-37aa-4244-930b-b26457de7cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:57.899716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5df01-37aa-4244-930b-b26457de7cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:57.900023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5df01-37aa-4244-930b-b26457de7cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:57.900281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5df01-37aa-4244-930b-b26457de7cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:57.902397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-91d5df01-37aa-4244-930b-b26457de7cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:57.914031 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5df01-37aa-4244-930b-b26457de7cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:57.915525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5df01-37aa-4244-930b-b26457de7cf6 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:57.923919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1085/2218] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:58.052093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb7a7-ce3c-4eb8-9717-c62c92d02f57 None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:58.052721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb7a7-ce3c-4eb8-9717-c62c92d02f57 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:58.052721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb7a7-ce3c-4eb8-9717-c62c92d02f57 None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:58.054102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1134/2219] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:25:58.060523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff7362-0a77-4302-8383-a7e64f5bca31 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:58.060882 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff7362-0a77-4302-8383-a7e64f5bca31 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:58.061160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff7362-0a77-4302-8383-a7e64f5bca31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:58.100816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d1ff7362-0a77-4302-8383-a7e64f5bca31 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:25:58.102045 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d1ff7362-0a77-4302-8383-a7e64f5bca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:58.112201 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1086/2220] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:25:58.123547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb7a7-ce3c-4eb8-9717-c62c92d02f57 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:58.125261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-99aeb7a7-ce3c-4eb8-9717-c62c92d02f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:58.188525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb7a7-ce3c-4eb8-9717-c62c92d02f57 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:58.192856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bcbcd-1aa3-4736-a7b3-4b815ef94259 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0055a33a380435d83a6d7384417c10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:58.193516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcbcd-1aa3-4736-a7b3-4b815ef94259 service glance] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:58.193806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcbcd-1aa3-4736-a7b3-4b815ef94259 service glance] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:58.194088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcbcd-1aa3-4736-a7b3-4b815ef94259 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:58.205076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bcbcd-1aa3-4736-a7b3-4b815ef94259 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:58.206560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bcbcd-1aa3-4736-a7b3-4b815ef94259 service glance] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:58.217585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1135/2221] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:25:58.289119 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb45d9-fb51-49ee-b859-f08b065400fa None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:58.289358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb45d9-fb51-49ee-b859-f08b065400fa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:58.289694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb45d9-fb51-49ee-b859-f08b065400fa None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:58.291196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1087/2222] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:25:58.297097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25888b-7273-458b-a4e8-dfd6b0da92f2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:58.297389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25888b-7273-458b-a4e8-dfd6b0da92f2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:58.297669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25888b-7273-458b-a4e8-dfd6b0da92f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:58.316682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-5e25888b-7273-458b-a4e8-dfd6b0da92f2 None None] MFA Rules not processed for user `0afeafd76edb40289d715f81485fa7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:25:58.317885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5e25888b-7273-458b-a4e8-dfd6b0da92f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:58.324663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1136/2223] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:25:58.340525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb45d9-fb51-49ee-b859-f08b065400fa None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:58.342414 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5ceb45d9-fb51-49ee-b859-f08b065400fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:58.360213 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb45d9-fb51-49ee-b859-f08b065400fa None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:58.364550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9cf20-a3a5-4edb-8c08-b7fecee67b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:58.365192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9cf20-a3a5-4edb-8c08-b7fecee67b05 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:58.365474 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9cf20-a3a5-4edb-8c08-b7fecee67b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:58.365785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9cf20-a3a5-4edb-8c08-b7fecee67b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:58.374226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9cf20-a3a5-4edb-8c08-b7fecee67b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:58.375752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9cf20-a3a5-4edb-8c08-b7fecee67b05 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:58.384694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1088/2224] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:58.470067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f1506-b642-464f-befa-b7951bdbe67b None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:58.470362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f1506-b642-464f-befa-b7951bdbe67b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:58.470669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f1506-b642-464f-befa-b7951bdbe67b None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:58.472122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1137/2225] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:25:58.477553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fb930-37de-44a9-b34e-4311ca4078a4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:58.477840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fb930-37de-44a9-b34e-4311ca4078a4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:58.478113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fb930-37de-44a9-b34e-4311ca4078a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:58.497262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-535fb930-37de-44a9-b34e-4311ca4078a4 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:25:58.498572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-535fb930-37de-44a9-b34e-4311ca4078a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:58.508516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1089/2226] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:25:58.519658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f1506-b642-464f-befa-b7951bdbe67b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:58.532789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f1506-b642-464f-befa-b7951bdbe67b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:58.537153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed540-c813-44fc-858a-7a616105398a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:58.537916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed540-c813-44fc-858a-7a616105398a service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:58.538204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed540-c813-44fc-858a-7a616105398a service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:58.538486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed540-c813-44fc-858a-7a616105398a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:58.549845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ed540-c813-44fc-858a-7a616105398a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:58.551231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ed540-c813-44fc-858a-7a616105398a service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:58.563456 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1138/2227] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:58.634072 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fb930-37de-44a9-b34e-4311ca4078a4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:58.636090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-535fb930-37de-44a9-b34e-4311ca4078a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:58.728599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fb930-37de-44a9-b34e-4311ca4078a4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:58.733961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b26d18-c248-46c6-a5ae-d96f7b2b0576 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:58.734663 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b26d18-c248-46c6-a5ae-d96f7b2b0576 service placement] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:58.734950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b26d18-c248-46c6-a5ae-d96f7b2b0576 service placement] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:58.735224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b26d18-c248-46c6-a5ae-d96f7b2b0576 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:58.737062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-61b26d18-c248-46c6-a5ae-d96f7b2b0576 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:58.749335 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b26d18-c248-46c6-a5ae-d96f7b2b0576 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:58.750953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b26d18-c248-46c6-a5ae-d96f7b2b0576 service placement] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:58.761425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1090/2228] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:00.302278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed540-c813-44fc-858a-7a616105398a service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:00.311781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed540-c813-44fc-858a-7a616105398a service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:00.317995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07be7f-5d5d-4d4f-a3f9-76a151313b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:00.318703 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07be7f-5d5d-4d4f-a3f9-76a151313b7e service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:00.318987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07be7f-5d5d-4d4f-a3f9-76a151313b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:00.320010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07be7f-5d5d-4d4f-a3f9-76a151313b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:00.322831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2e07be7f-5d5d-4d4f-a3f9-76a151313b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:00.339566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07be7f-5d5d-4d4f-a3f9-76a151313b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:00.343397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07be7f-5d5d-4d4f-a3f9-76a151313b7e service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:00.353044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1139/2229] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:01.262704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1133d0-1fde-4386-95b0-266c04fa821f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:01.263200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1133d0-1fde-4386-95b0-266c04fa821f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:01.263320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1133d0-1fde-4386-95b0-266c04fa821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:01.282098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8d1133d0-1fde-4386-95b0-266c04fa821f None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:01.283354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8d1133d0-1fde-4386-95b0-266c04fa821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:01.291658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1091/2230] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:01.303868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07be7f-5d5d-4d4f-a3f9-76a151313b7e service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:01.317186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07be7f-5d5d-4d4f-a3f9-76a151313b7e service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:01.323547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c645446-ed54-42c1-9471-f84f1cdd9f43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:01.324260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c645446-ed54-42c1-9471-f84f1cdd9f43 service swift] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:01.324518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c645446-ed54-42c1-9471-f84f1cdd9f43 service swift] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:01.324850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c645446-ed54-42c1-9471-f84f1cdd9f43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:01.334292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c645446-ed54-42c1-9471-f84f1cdd9f43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:01.335939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c645446-ed54-42c1-9471-f84f1cdd9f43 service swift] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:01.344450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1140/2231] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:26:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:26:11.276535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=59 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:11.341274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=53 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:28.828216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1133d0-1fde-4386-95b0-266c04fa821f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:28.830402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8d1133d0-1fde-4386-95b0-266c04fa821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:28.856155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1133d0-1fde-4386-95b0-266c04fa821f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:28.862101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852f2eb-0955-4ac0-bdcb-e137aff1c829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:28.862823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852f2eb-0955-4ac0-bdcb-e137aff1c829 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:28.863122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852f2eb-0955-4ac0-bdcb-e137aff1c829 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:28.863400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852f2eb-0955-4ac0-bdcb-e137aff1c829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:28.865456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3852f2eb-0955-4ac0-bdcb-e137aff1c829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:28.882447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852f2eb-0955-4ac0-bdcb-e137aff1c829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:28.884208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852f2eb-0955-4ac0-bdcb-e137aff1c829 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:28.897506 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1092/2232] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:26:31.838121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c85f7-2237-4d40-97f9-7ba546894ac2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:31.838738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c85f7-2237-4d40-97f9-7ba546894ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:31.838738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c85f7-2237-4d40-97f9-7ba546894ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:31.860923 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-7c4c85f7-2237-4d40-97f9-7ba546894ac2 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:31.862593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-7c4c85f7-2237-4d40-97f9-7ba546894ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:31.875709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1141/2233] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 10:26:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:31.888261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852f2eb-0955-4ac0-bdcb-e137aff1c829 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:31.900087 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852f2eb-0955-4ac0-bdcb-e137aff1c829 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:31.906650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44e322-b92c-45b3-84af-a667b262f065 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:31.907301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44e322-b92c-45b3-84af-a667b262f065 service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:31.907636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44e322-b92c-45b3-84af-a667b262f065 service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:31.907936 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44e322-b92c-45b3-84af-a667b262f065 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:31.917518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44e322-b92c-45b3-84af-a667b262f065 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:31.919141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44e322-b92c-45b3-84af-a667b262f065 service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:31.928058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1093/2234] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:26:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:26:35.927425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c85f7-2237-4d40-97f9-7ba546894ac2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:35.945190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c85f7-2237-4d40-97f9-7ba546894ac2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:35.953203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7aaab4-c6f5-4571-8fc8-a0c4a62f79c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:35.953869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7aaab4-c6f5-4571-8fc8-a0c4a62f79c0 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:35.954148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7aaab4-c6f5-4571-8fc8-a0c4a62f79c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:35.954407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7aaab4-c6f5-4571-8fc8-a0c4a62f79c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:35.956676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5f7aaab4-c6f5-4571-8fc8-a0c4a62f79c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:36.022755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7aaab4-c6f5-4571-8fc8-a0c4a62f79c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:36.024372 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7aaab4-c6f5-4571-8fc8-a0c4a62f79c0 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:36.034160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1142/2235] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:41.924445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=12 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:46.029894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=31 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:59.716270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4ccee-3c5c-408d-9c66-c7a64dde468a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:59.716822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4ccee-3c5c-408d-9c66-c7a64dde468a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:59.716822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4ccee-3c5c-408d-9c66-c7a64dde468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:59.737470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-87c4ccee-3c5c-408d-9c66-c7a64dde468a None None] MFA Rules not processed for user `8fc916f852f4433eac4a3a2a12384834`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:59.738754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-87c4ccee-3c5c-408d-9c66-c7a64dde468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:59.747824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1094/2236] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:27:05.282631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7aaab4-c6f5-4571-8fc8-a0c4a62f79c0 service nova] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:05.295917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7aaab4-c6f5-4571-8fc8-a0c4a62f79c0 service nova] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:05.307289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc7ea4-2014-40aa-80df-2ad16ce12817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:05.307976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc7ea4-2014-40aa-80df-2ad16ce12817 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:05.308257 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc7ea4-2014-40aa-80df-2ad16ce12817 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:05.308535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc7ea4-2014-40aa-80df-2ad16ce12817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:05.310583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c7fc7ea4-2014-40aa-80df-2ad16ce12817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:05.323794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc7ea4-2014-40aa-80df-2ad16ce12817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:05.325450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc7ea4-2014-40aa-80df-2ad16ce12817 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:05.339789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1143/2237] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:07.447184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4ccee-3c5c-408d-9c66-c7a64dde468a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:07.460963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4ccee-3c5c-408d-9c66-c7a64dde468a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:07.467224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad88935-6982-49fc-b75a-4207b16cbc93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:07.467755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88935-6982-49fc-b75a-4207b16cbc93 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:07.468036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88935-6982-49fc-b75a-4207b16cbc93 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:07.468308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88935-6982-49fc-b75a-4207b16cbc93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:07.470296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5ad88935-6982-49fc-b75a-4207b16cbc93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:07.533023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad88935-6982-49fc-b75a-4207b16cbc93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:07.534669 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad88935-6982-49fc-b75a-4207b16cbc93 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:07.544392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1095/2238] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:15.332399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=6 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:17.540702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=31 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:22.524197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc7ea4-2014-40aa-80df-2ad16ce12817 service nova] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:22.540156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc7ea4-2014-40aa-80df-2ad16ce12817 service nova] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:22.565308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7087-b997-4d17-b77d-a0b3a6d20625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:22.566060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7087-b997-4d17-b77d-a0b3a6d20625 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:22.566353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7087-b997-4d17-b77d-a0b3a6d20625 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:22.566654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7087-b997-4d17-b77d-a0b3a6d20625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:22.568552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-70eb7087-b997-4d17-b77d-a0b3a6d20625 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:22.581928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb7087-b997-4d17-b77d-a0b3a6d20625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:22.583740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb7087-b997-4d17-b77d-a0b3a6d20625 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:22.603886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1144/2239] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:24.178099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8f58-2843-4548-8857-68c2e22a386d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:24.178628 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8f58-2843-4548-8857-68c2e22a386d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:24.178733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8f58-2843-4548-8857-68c2e22a386d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:24.196421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-eeee8f58-2843-4548-8857-68c2e22a386d None None] MFA Rules not processed for user `a394fc62e6a64a85b855bf2eb56b4b71`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:27:24.197641 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eeee8f58-2843-4548-8857-68c2e22a386d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:24.263776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1096/2240] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:27:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:27:32.308465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7087-b997-4d17-b77d-a0b3a6d20625 service nova] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:32.320260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7087-b997-4d17-b77d-a0b3a6d20625 service nova] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:32.327919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa35f86-8ec9-4449-a8a0-1a5942e10111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:32.328591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa35f86-8ec9-4449-a8a0-1a5942e10111 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:32.328875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa35f86-8ec9-4449-a8a0-1a5942e10111 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:32.329159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa35f86-8ec9-4449-a8a0-1a5942e10111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:32.331481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8fa35f86-8ec9-4449-a8a0-1a5942e10111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:32.343115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa35f86-8ec9-4449-a8a0-1a5942e10111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:32.344704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa35f86-8ec9-4449-a8a0-1a5942e10111 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:32.354002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1145/2241] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:34.256287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=25 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:42.349852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=12 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:51.191479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01db8a2-fb57-44df-9a10-54f0f0d54077 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:51.192004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01db8a2-fb57-44df-9a10-54f0f0d54077 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:51.192126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01db8a2-fb57-44df-9a10-54f0f0d54077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:51.213868 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c01db8a2-fb57-44df-9a10-54f0f0d54077 None None] MFA Rules not processed for user `da80b9a52feb462faf0469f2ab701fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:27:51.215116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c01db8a2-fb57-44df-9a10-54f0f0d54077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:51.222771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1097/2242] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:27:58.326234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519529-751a-46a0-a134-1b4537560510 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:58.326837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519529-751a-46a0-a134-1b4537560510 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:58.326837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519529-751a-46a0-a134-1b4537560510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:58.345522 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8f519529-751a-46a0-a134-1b4537560510 None None] MFA Rules not processed for user `60dbe36087e14f9e8bf885977b0e7426`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:27:58.346765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8f519529-751a-46a0-a134-1b4537560510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:58.354202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1146/2243] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:27:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:28:01.208362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:08.339757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:36.703512 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01db8a2-fb57-44df-9a10-54f0f0d54077 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:36.714790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01db8a2-fb57-44df-9a10-54f0f0d54077 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:36.718798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01446724-0fcc-4d3b-be28-6eddd3a7d1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:36.719634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01446724-0fcc-4d3b-be28-6eddd3a7d1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:36.719912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01446724-0fcc-4d3b-be28-6eddd3a7d1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:36.720179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01446724-0fcc-4d3b-be28-6eddd3a7d1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:36.722040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-01446724-0fcc-4d3b-be28-6eddd3a7d1f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:36.796211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01446724-0fcc-4d3b-be28-6eddd3a7d1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:36.797685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01446724-0fcc-4d3b-be28-6eddd3a7d1f9 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:36.812547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1098/2244] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:28:39.287779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519529-751a-46a0-a134-1b4537560510 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:39.290376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8f519529-751a-46a0-a134-1b4537560510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:39.323702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519529-751a-46a0-a134-1b4537560510 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:39.337239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72c107-3b1b-490d-8201-e7dcaef8d4ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:39.340029 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c107-3b1b-490d-8201-e7dcaef8d4ca service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:39.340756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c107-3b1b-490d-8201-e7dcaef8d4ca service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:39.342098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c107-3b1b-490d-8201-e7dcaef8d4ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:39.350200 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ae72c107-3b1b-490d-8201-e7dcaef8d4ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:39.378913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72c107-3b1b-490d-8201-e7dcaef8d4ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:39.386901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72c107-3b1b-490d-8201-e7dcaef8d4ca service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:39.415804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1147/2245] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:28:41.299366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01446724-0fcc-4d3b-be28-6eddd3a7d1f9 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:41.313875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01446724-0fcc-4d3b-be28-6eddd3a7d1f9 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:41.334820 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255eade-9893-41e1-a0d3-6e57a04456ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:41.335725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255eade-9893-41e1-a0d3-6e57a04456ea service placement] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:41.336015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255eade-9893-41e1-a0d3-6e57a04456ea service placement] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:41.336298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255eade-9893-41e1-a0d3-6e57a04456ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:41.340935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b255eade-9893-41e1-a0d3-6e57a04456ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:41.361144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255eade-9893-41e1-a0d3-6e57a04456ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:41.363571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255eade-9893-41e1-a0d3-6e57a04456ea service placement] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:41.376088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1099/2246] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:41.429197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72c107-3b1b-490d-8201-e7dcaef8d4ca service placement] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:41.430784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ae72c107-3b1b-490d-8201-e7dcaef8d4ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:41.456424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72c107-3b1b-490d-8201-e7dcaef8d4ca service placement] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:41.464668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:41.466644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:41.467019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:41.467400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] PATH_INFO: `/v3/users/8fc916f852f4433eac4a3a2a12384834` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:41.469523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc916f852f4433eac4a3a2a12384834)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:41.473523 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:41.546046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc916f852f4433eac4a3a2a12384834'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:41.546794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc916f852f4433eac4a3a2a12384834'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:41.547415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc916f852f4433eac4a3a2a12384834'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:41.567943 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc916f852f4433eac4a3a2a12384834'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:41.579588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd2aa8a8-3ae6-4f2c-bcb8-f1a9bcec206b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc916f852f4433eac4a3a2a12384834'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:41.596631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1148/2247] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:28:41 2022] DELETE /identity/v3/users/8fc916f852f4433eac4a3a2a12384834 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:41.832385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255eade-9893-41e1-a0d3-6e57a04456ea service placement] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:41.862896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255eade-9893-41e1-a0d3-6e57a04456ea service placement] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:41.947817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:41.949476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:41.949982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:41.950470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] PATH_INFO: `/v3/projects/f20791fa785649cfa5df1f60df84dbdb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:41.952951 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20791fa785649cfa5df1f60df84dbdb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:41.956686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:42.044101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20791fa785649cfa5df1f60df84dbdb', 'request_id': 'req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:42.051363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20791fa785649cfa5df1f60df84dbdb', 'request_id': 'req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:42.060733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20791fa785649cfa5df1f60df84dbdb', 'request_id': 'req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:42.073465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] The token cache is being invalidate because project f20791fa785649cfa5df1f60df84dbdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:28:42.073755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:42.074416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1cfbae5c-01fe-4eae-bab9-f80b84b831ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:42.076055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1100/2248] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:28:41 2022] DELETE /identity/v3/projects/f20791fa785649cfa5df1f60df84dbdb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:42.081716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc91530-4381-499d-940c-5bff46476507 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:42.081999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc91530-4381-499d-940c-5bff46476507 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:42.082345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc91530-4381-499d-940c-5bff46476507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:42.103016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-ffc91530-4381-499d-940c-5bff46476507 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:42.104265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ffc91530-4381-499d-940c-5bff46476507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:42.179127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1149/2249] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:28:42.187549 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e80c5c-886f-464f-a1e2-b77d5c10c288 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:42.188002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e80c5c-886f-464f-a1e2-b77d5c10c288 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:42.188210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e80c5c-886f-464f-a1e2-b77d5c10c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:42.212124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-93e80c5c-886f-464f-a1e2-b77d5c10c288 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:42.213386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-93e80c5c-886f-464f-a1e2-b77d5c10c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:42.222580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1101/2250] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:42.227444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc91530-4381-499d-940c-5bff46476507 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:42.240514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc91530-4381-499d-940c-5bff46476507 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:42.247068 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afa598-ccb1-48ef-b7e9-6a28bac6d533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:42.248198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afa598-ccb1-48ef-b7e9-6a28bac6d533 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:42.248685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afa598-ccb1-48ef-b7e9-6a28bac6d533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:42.249140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afa598-ccb1-48ef-b7e9-6a28bac6d533 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:42.250457 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afa598-ccb1-48ef-b7e9-6a28bac6d533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:28:42.250823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afa598-ccb1-48ef-b7e9-6a28bac6d533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:42.254084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afa598-ccb1-48ef-b7e9-6a28bac6d533 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:42.285517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1150/2251] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:28:42.290585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e80c5c-886f-464f-a1e2-b77d5c10c288 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:42.298542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:42.305216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e80c5c-886f-464f-a1e2-b77d5c10c288 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:42.320168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb3384-e62d-47ec-ad5a-165af23494a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:42.320856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3384-e62d-47ec-ad5a-165af23494a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:42.321460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3384-e62d-47ec-ad5a-165af23494a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:42.322054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3384-e62d-47ec-ad5a-165af23494a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:42.323198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb3384-e62d-47ec-ad5a-165af23494a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:42.325685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb3384-e62d-47ec-ad5a-165af23494a4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:42.394772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1102/2252] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:28:42 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:42.399521 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afa598-ccb1-48ef-b7e9-6a28bac6d533 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:42.411670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afa598-ccb1-48ef-b7e9-6a28bac6d533 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:42.471834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:42.488893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16de898-d7be-4057-9eb4-67096c2d83f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:42.489624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de898-d7be-4057-9eb4-67096c2d83f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:42.489913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de898-d7be-4057-9eb4-67096c2d83f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:42.490191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de898-d7be-4057-9eb4-67096c2d83f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:42.490942 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16de898-d7be-4057-9eb4-67096c2d83f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:42.492946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16de898-d7be-4057-9eb4-67096c2d83f6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:42.515689 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1151/2253] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:28:42 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:42.520077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb3384-e62d-47ec-ad5a-165af23494a4 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:42.531434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb3384-e62d-47ec-ad5a-165af23494a4 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:42.536521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e84877-e622-4f44-a59f-bd606845f5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:42.537361 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e84877-e622-4f44-a59f-bd606845f5cc admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:42.537644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e84877-e622-4f44-a59f-bd606845f5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:42.537908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e84877-e622-4f44-a59f-bd606845f5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:42.538683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e84877-e622-4f44-a59f-bd606845f5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:42.540311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e84877-e622-4f44-a59f-bd606845f5cc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:42.552061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1103/2254] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:28:42.555902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16de898-d7be-4057-9eb4-67096c2d83f6 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:42.576979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16de898-d7be-4057-9eb4-67096c2d83f6 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:42.583570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178fdd5-97e8-4cb8-bff8-39c9d421957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:42.584789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178fdd5-97e8-4cb8-bff8-39c9d421957e admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:42.585079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178fdd5-97e8-4cb8-bff8-39c9d421957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:42.585352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178fdd5-97e8-4cb8-bff8-39c9d421957e admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:42.586129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178fdd5-97e8-4cb8-bff8-39c9d421957e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:42.587822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178fdd5-97e8-4cb8-bff8-39c9d421957e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:42.598919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1152/2255] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:28:42.603326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e84877-e622-4f44-a59f-bd606845f5cc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:42.615181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e84877-e622-4f44-a59f-bd606845f5cc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:42.625875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe324690-a4aa-4340-af8a-0bcae35132d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:42.626833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe324690-a4aa-4340-af8a-0bcae35132d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:42.627127 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe324690-a4aa-4340-af8a-0bcae35132d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:42.627399 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe324690-a4aa-4340-af8a-0bcae35132d6 admin admin] PATH_INFO: `/v3/projects/023252a8411e4e8197bb918a03563c1c/users/1c6af0c2291c433aaeac05c7fcb3d002/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:42.647817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe324690-a4aa-4340-af8a-0bcae35132d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023252a8411e4e8197bb918a03563c1c, user_id=1c6af0c2291c433aaeac05c7fcb3d002, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:42.650911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe324690-a4aa-4340-af8a-0bcae35132d6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:42.669488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1104/2256] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:28:42 2022] PUT /identity/v3/projects/023252a8411e4e8197bb918a03563c1c/users/1c6af0c2291c433aaeac05c7fcb3d002/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:28:42.681640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377757f-0a08-4bc2-88c8-d0fd56dda21a None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:42.682086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377757f-0a08-4bc2-88c8-d0fd56dda21a None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:42.682610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377757f-0a08-4bc2-88c8-d0fd56dda21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:42.719918 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-3377757f-0a08-4bc2-88c8-d0fd56dda21a None None] MFA Rules not processed for user `1c6af0c2291c433aaeac05c7fcb3d002`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:42.721951 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3377757f-0a08-4bc2-88c8-d0fd56dda21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:42.834633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1153/2257] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:28:42.847916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe324690-a4aa-4340-af8a-0bcae35132d6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:42.849851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fe324690-a4aa-4340-af8a-0bcae35132d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:42.951289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe324690-a4aa-4340-af8a-0bcae35132d6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:42.958114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432644-98b5-4c14-ae09-163920b34a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:42.959056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432644-98b5-4c14-ae09-163920b34a03 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:42.959444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432644-98b5-4c14-ae09-163920b34a03 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:42.959824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432644-98b5-4c14-ae09-163920b34a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:42.970037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a432644-98b5-4c14-ae09-163920b34a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:42.971731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a432644-98b5-4c14-ae09-163920b34a03 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:42.982918 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1105/2258] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:28:43.146825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3133be-c16a-4781-a9e6-88b0018c49d0 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:43.147161 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3133be-c16a-4781-a9e6-88b0018c49d0 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:43.147479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3133be-c16a-4781-a9e6-88b0018c49d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:43.176826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-ef3133be-c16a-4781-a9e6-88b0018c49d0 None None] MFA Rules not processed for user `595531abf958489795f2363026697a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:43.178048 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ef3133be-c16a-4781-a9e6-88b0018c49d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:43.263279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1154/2259] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:28:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:43.888462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432644-98b5-4c14-ae09-163920b34a03 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:43.890316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8a432644-98b5-4c14-ae09-163920b34a03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:43.975666 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432644-98b5-4c14-ae09-163920b34a03 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:43.981990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a986-48af-468f-8657-8df43b27148d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:43.983178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a986-48af-468f-8657-8df43b27148d service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:43.983714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a986-48af-468f-8657-8df43b27148d service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:43.984217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a986-48af-468f-8657-8df43b27148d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:43.987450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6636a986-48af-468f-8657-8df43b27148d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:44.002216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636a986-48af-468f-8657-8df43b27148d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:44.003828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636a986-48af-468f-8657-8df43b27148d service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:44.013274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1106/2260] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:52.819327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3133be-c16a-4781-a9e6-88b0018c49d0 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:52.894714 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3133be-c16a-4781-a9e6-88b0018c49d0 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:52.899774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:52.900865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:52.901171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:52.901470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] PATH_INFO: `/v3/users/1c6af0c2291c433aaeac05c7fcb3d002` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:52.903501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6af0c2291c433aaeac05c7fcb3d002)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:52.905664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:52.907922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:52.967212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6af0c2291c433aaeac05c7fcb3d002'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:52.967902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6af0c2291c433aaeac05c7fcb3d002'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:52.968515 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6af0c2291c433aaeac05c7fcb3d002'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:52.983558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6af0c2291c433aaeac05c7fcb3d002'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:52.994242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6af0c2291c433aaeac05c7fcb3d002'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.011420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1155/2261] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:28:52 2022] DELETE /identity/v3/users/1c6af0c2291c433aaeac05c7fcb3d002 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:53.018786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109c89-a229-49ce-8ddc-e68db9d14895 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:53.019471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109c89-a229-49ce-8ddc-e68db9d14895 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:53.019868 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109c89-a229-49ce-8ddc-e68db9d14895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:53.049857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b1109c89-a229-49ce-8ddc-e68db9d14895 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:53.052238 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b1109c89-a229-49ce-8ddc-e68db9d14895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:53.080364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:53.133830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1107/2262] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:53.145021 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:53.146884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:53.242194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb73258-a708-4bb5-9d01-19b4b4e26ff1 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:53.248741 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc046892-bdc8-480d-ba15-80233272e3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:53.249866 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc046892-bdc8-480d-ba15-80233272e3ac service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:53.250365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc046892-bdc8-480d-ba15-80233272e3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:53.250902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc046892-bdc8-480d-ba15-80233272e3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:53.263113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc046892-bdc8-480d-ba15-80233272e3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:53.265071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc046892-bdc8-480d-ba15-80233272e3ac service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:53.276760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1156/2263] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:53.607864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1109c89-a229-49ce-8ddc-e68db9d14895 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:53.609707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b1109c89-a229-49ce-8ddc-e68db9d14895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:53.629430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1109c89-a229-49ce-8ddc-e68db9d14895 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:53.637586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:53.638642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:53.639105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:53.639596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] PATH_INFO: `/v3/projects/023252a8411e4e8197bb918a03563c1c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:53.642538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=023252a8411e4e8197bb918a03563c1c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:53.646335 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:53.724555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023252a8411e4e8197bb918a03563c1c', 'request_id': 'req-bbce5743-9949-4e70-9c32-a48bf82aaf4b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.732343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023252a8411e4e8197bb918a03563c1c', 'request_id': 'req-bbce5743-9949-4e70-9c32-a48bf82aaf4b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.742938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023252a8411e4e8197bb918a03563c1c', 'request_id': 'req-bbce5743-9949-4e70-9c32-a48bf82aaf4b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.757123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] The token cache is being invalidate because project 023252a8411e4e8197bb918a03563c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:28:53.757511 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.758327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bbce5743-9949-4e70-9c32-a48bf82aaf4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.760047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1108/2264] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:28:53 2022] DELETE /identity/v3/projects/023252a8411e4e8197bb918a03563c1c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:53.765563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72dc4b-de0b-4a1f-a949-5e82cab6dc89 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:53.765826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72dc4b-de0b-4a1f-a949-5e82cab6dc89 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:53.766126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72dc4b-de0b-4a1f-a949-5e82cab6dc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:53.787033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-fc72dc4b-de0b-4a1f-a949-5e82cab6dc89 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:53.787926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-fc72dc4b-de0b-4a1f-a949-5e82cab6dc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:53.885550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1157/2265] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:53.896395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ab183-b1cd-4f4e-a89b-562ad4d56dad None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:53.896912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ab183-b1cd-4f4e-a89b-562ad4d56dad None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:53.897489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ab183-b1cd-4f4e-a89b-562ad4d56dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:53.930426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a88ab183-b1cd-4f4e-a89b-562ad4d56dad None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:53.932495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a88ab183-b1cd-4f4e-a89b-562ad4d56dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:53.945877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1109/2266] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:53.951812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72dc4b-de0b-4a1f-a949-5e82cab6dc89 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:53.972619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72dc4b-de0b-4a1f-a949-5e82cab6dc89 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:53.982631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d177c6a-07dc-4088-a8ca-8fe73126e4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:53.983780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d177c6a-07dc-4088-a8ca-8fe73126e4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:53.984570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d177c6a-07dc-4088-a8ca-8fe73126e4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:53.985074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d177c6a-07dc-4088-a8ca-8fe73126e4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:53.986641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d177c6a-07dc-4088-a8ca-8fe73126e4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:28:53.987229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d177c6a-07dc-4088-a8ca-8fe73126e4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:53.990752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d177c6a-07dc-4088-a8ca-8fe73126e4a3 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.012141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1158/2267] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:28:54.016775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ab183-b1cd-4f4e-a89b-562ad4d56dad None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.028341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ab183-b1cd-4f4e-a89b-562ad4d56dad None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.034288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7eaf7c-928f-4a16-874e-88f77fd74c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.035042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eaf7c-928f-4a16-874e-88f77fd74c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.035374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eaf7c-928f-4a16-874e-88f77fd74c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.035650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eaf7c-928f-4a16-874e-88f77fd74c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.036389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eaf7c-928f-4a16-874e-88f77fd74c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.038352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eaf7c-928f-4a16-874e-88f77fd74c2a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.068886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1110/2268] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:28:54 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:54.073719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d177c6a-07dc-4088-a8ca-8fe73126e4a3 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.085593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d177c6a-07dc-4088-a8ca-8fe73126e4a3 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.091759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:54.157862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a170f0-526a-40ab-863a-9ce6fbb3ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.158471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a170f0-526a-40ab-863a-9ce6fbb3ee7a admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.158795 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a170f0-526a-40ab-863a-9ce6fbb3ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.159057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a170f0-526a-40ab-863a-9ce6fbb3ee7a admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.159811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a170f0-526a-40ab-863a-9ce6fbb3ee7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.162041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a170f0-526a-40ab-863a-9ce6fbb3ee7a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.185250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1159/2269] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:28:54 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:54.190186 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7eaf7c-928f-4a16-874e-88f77fd74c2a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.202495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7eaf7c-928f-4a16-874e-88f77fd74c2a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.208338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685cf30-1130-49c1-897c-de178f55eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.209034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685cf30-1130-49c1-897c-de178f55eca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.209320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685cf30-1130-49c1-897c-de178f55eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.209597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685cf30-1130-49c1-897c-de178f55eca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.210352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685cf30-1130-49c1-897c-de178f55eca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.212089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685cf30-1130-49c1-897c-de178f55eca3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.224424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1111/2270] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:28:54.229240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a170f0-526a-40ab-863a-9ce6fbb3ee7a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.240855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a170f0-526a-40ab-863a-9ce6fbb3ee7a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.247009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dab76c-36c0-4b10-b292-b45747acd87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.247707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dab76c-36c0-4b10-b292-b45747acd87b admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.247998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dab76c-36c0-4b10-b292-b45747acd87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.248272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dab76c-36c0-4b10-b292-b45747acd87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.249060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dab76c-36c0-4b10-b292-b45747acd87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.250755 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dab76c-36c0-4b10-b292-b45747acd87b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.265050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1160/2271] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:28:54.271921 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685cf30-1130-49c1-897c-de178f55eca3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.287002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685cf30-1130-49c1-897c-de178f55eca3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.292386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11b1ad-f693-40bb-9689-c7c126f9bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.293349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b1ad-f693-40bb-9689-c7c126f9bdb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.293627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b1ad-f693-40bb-9689-c7c126f9bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.293902 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b1ad-f693-40bb-9689-c7c126f9bdb9 admin admin] PATH_INFO: `/v3/projects/cda145618eb74be0be06c633e547fa6d/users/6ef8f5d8703b4431bfc0667ae867a796/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.312145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11b1ad-f693-40bb-9689-c7c126f9bdb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda145618eb74be0be06c633e547fa6d, user_id=6ef8f5d8703b4431bfc0667ae867a796, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.314956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11b1ad-f693-40bb-9689-c7c126f9bdb9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.333864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1112/2272] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:28:54 2022] PUT /identity/v3/projects/cda145618eb74be0be06c633e547fa6d/users/6ef8f5d8703b4431bfc0667ae867a796/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:54.346610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757d12-6282-47ed-a237-d87da85bd45e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.347010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757d12-6282-47ed-a237-d87da85bd45e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.347354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757d12-6282-47ed-a237-d87da85bd45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.381386 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-17757d12-6282-47ed-a237-d87da85bd45e None None] MFA Rules not processed for user `6ef8f5d8703b4431bfc0667ae867a796`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:54.382830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-17757d12-6282-47ed-a237-d87da85bd45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:54.482365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1161/2273] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:28:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:54.487709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11b1ad-f693-40bb-9689-c7c126f9bdb9 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.559668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:54.585770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11b1ad-f693-40bb-9689-c7c126f9bdb9 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.592555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40278e-9740-4ebe-ab5b-49a8ff307c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.593482 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40278e-9740-4ebe-ab5b-49a8ff307c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.593901 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40278e-9740-4ebe-ab5b-49a8ff307c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.594355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40278e-9740-4ebe-ab5b-49a8ff307c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.595298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40278e-9740-4ebe-ab5b-49a8ff307c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.597743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40278e-9740-4ebe-ab5b-49a8ff307c1e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.643176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1113/2274] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:28:54 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:54.645108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17757d12-6282-47ed-a237-d87da85bd45e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.659264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17757d12-6282-47ed-a237-d87da85bd45e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.767580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a46c1-5557-476e-8b87-70e4e56adcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.768894 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a46c1-5557-476e-8b87-70e4e56adcbf admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.769515 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a46c1-5557-476e-8b87-70e4e56adcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.770048 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a46c1-5557-476e-8b87-70e4e56adcbf admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.771452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a46c1-5557-476e-8b87-70e4e56adcbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.775481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a46c1-5557-476e-8b87-70e4e56adcbf admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.802723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1162/2275] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:28:54 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:54.807857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40278e-9740-4ebe-ab5b-49a8ff307c1e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.820136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40278e-9740-4ebe-ab5b-49a8ff307c1e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.826130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab021ec-8bc4-4787-b37a-b6cd7957d08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.826885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab021ec-8bc4-4787-b37a-b6cd7957d08a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.827172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab021ec-8bc4-4787-b37a-b6cd7957d08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.827450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab021ec-8bc4-4787-b37a-b6cd7957d08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.828228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab021ec-8bc4-4787-b37a-b6cd7957d08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.829912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab021ec-8bc4-4787-b37a-b6cd7957d08a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.844572 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1114/2276] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:28:54.850165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a46c1-5557-476e-8b87-70e4e56adcbf admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.861041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a46c1-5557-476e-8b87-70e4e56adcbf admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.867445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050316bc-5be7-48f1-850b-4d124feab4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.868604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050316bc-5be7-48f1-850b-4d124feab4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.869111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050316bc-5be7-48f1-850b-4d124feab4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.869574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050316bc-5be7-48f1-850b-4d124feab4ac admin admin] PATH_INFO: `/v3/projects/ccda2302ca444d5c80735ac87da8115a/users/e43f8d25958d49c699afd8a51e0a6198/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.873370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:54.891496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050316bc-5be7-48f1-850b-4d124feab4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccda2302ca444d5c80735ac87da8115a, user_id=e43f8d25958d49c699afd8a51e0a6198, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.894639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050316bc-5be7-48f1-850b-4d124feab4ac admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.911011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1163/2277] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:28:54 2022] PUT /identity/v3/projects/ccda2302ca444d5c80735ac87da8115a/users/e43f8d25958d49c699afd8a51e0a6198/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:54.915485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab021ec-8bc4-4787-b37a-b6cd7957d08a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.927525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab021ec-8bc4-4787-b37a-b6cd7957d08a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.998612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e474d4-3254-48b4-b103-601818ffd989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.999471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e474d4-3254-48b4-b103-601818ffd989 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.999801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e474d4-3254-48b4-b103-601818ffd989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:55.000121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e474d4-3254-48b4-b103-601818ffd989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:55.000991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e474d4-3254-48b4-b103-601818ffd989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:55.002759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e474d4-3254-48b4-b103-601818ffd989 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:55.021040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1115/2278] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:28:55.022371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050316bc-5be7-48f1-850b-4d124feab4ac admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:55.034162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050316bc-5be7-48f1-850b-4d124feab4ac admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:55.043356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cce608-ea9e-4beb-8eb3-cc6b9c760a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:55.044886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cce608-ea9e-4beb-8eb3-cc6b9c760a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:55.045362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cce608-ea9e-4beb-8eb3-cc6b9c760a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:55.045808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cce608-ea9e-4beb-8eb3-cc6b9c760a93 admin admin] PATH_INFO: `/v3/projects/ccda2302ca444d5c80735ac87da8115a/users/e43f8d25958d49c699afd8a51e0a6198/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:55.049828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cce608-ea9e-4beb-8eb3-cc6b9c760a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccda2302ca444d5c80735ac87da8115a, user_id=e43f8d25958d49c699afd8a51e0a6198, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:55.055373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cce608-ea9e-4beb-8eb3-cc6b9c760a93 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:55.076147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1164/2279] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:28:55 2022] PUT /identity/v3/projects/ccda2302ca444d5c80735ac87da8115a/users/e43f8d25958d49c699afd8a51e0a6198/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:55.093850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bf489-f6ad-4a4f-8669-98f001dca8ed None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:55.094737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bf489-f6ad-4a4f-8669-98f001dca8ed None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:55.094902 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bf489-f6ad-4a4f-8669-98f001dca8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:55.132790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-168bf489-f6ad-4a4f-8669-98f001dca8ed None None] MFA Rules not processed for user `e43f8d25958d49c699afd8a51e0a6198`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:55.134165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-168bf489-f6ad-4a4f-8669-98f001dca8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:55.231732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1116/2280] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:28:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:28:55.244680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cce608-ea9e-4beb-8eb3-cc6b9c760a93 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:55.247144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-03cce608-ea9e-4beb-8eb3-cc6b9c760a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:55.320532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cce608-ea9e-4beb-8eb3-cc6b9c760a93 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:55.324686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70c549-4552-4b22-99f2-dc3863de3b1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:55.325373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70c549-4552-4b22-99f2-dc3863de3b1f service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:55.325657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70c549-4552-4b22-99f2-dc3863de3b1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:55.325930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70c549-4552-4b22-99f2-dc3863de3b1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:55.336947 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70c549-4552-4b22-99f2-dc3863de3b1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:55.338425 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70c549-4552-4b22-99f2-dc3863de3b1f service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:55.350171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1165/2281] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:55.436536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bf489-f6ad-4a4f-8669-98f001dca8ed None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:55.449180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bf489-f6ad-4a4f-8669-98f001dca8ed None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:55.454004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ec06-7aca-4559-bca2-7c25e6cbb9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:55.454735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ec06-7aca-4559-bca2-7c25e6cbb9cc service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:55.455065 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ec06-7aca-4559-bca2-7c25e6cbb9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:55.455390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ec06-7aca-4559-bca2-7c25e6cbb9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:55.518570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:55.546939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ec06-7aca-4559-bca2-7c25e6cbb9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:55.549632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ec06-7aca-4559-bca2-7c25e6cbb9cc service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:55.567637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1117/2282] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:05.344712 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=38,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:05.559798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=9 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:43.125805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70c549-4552-4b22-99f2-dc3863de3b1f service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:43.199203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70c549-4552-4b22-99f2-dc3863de3b1f service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:43.204518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:43.205713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:43.205994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:43.206274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] PATH_INFO: `/v3/users/6ef8f5d8703b4431bfc0667ae867a796` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:43.207644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ef8f5d8703b4431bfc0667ae867a796)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:43.209618 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:43.275833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ef8f5d8703b4431bfc0667ae867a796'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:43.276573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ef8f5d8703b4431bfc0667ae867a796'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:43.277212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ef8f5d8703b4431bfc0667ae867a796'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:43.291896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ef8f5d8703b4431bfc0667ae867a796'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:43.301778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ef8f5d8703b4431bfc0667ae867a796'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:43.319545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1166/2283] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:43 2022] DELETE /identity/v3/users/6ef8f5d8703b4431bfc0667ae867a796 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:43.324373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86476643-db30-42c2-8a76-1be21286604a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:43.325048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86476643-db30-42c2-8a76-1be21286604a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:43.325048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86476643-db30-42c2-8a76-1be21286604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:43.344347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-86476643-db30-42c2-8a76-1be21286604a None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:43.345613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-86476643-db30-42c2-8a76-1be21286604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:43.421569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1118/2284] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:43.432368 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:43.434424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:43.501897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646783f-58f7-4646-9922-4b9ddbd96af5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:43.505953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c1c14-2ce0-448b-af88-8b2c5c97fe3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:43.506680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c1c14-2ce0-448b-af88-8b2c5c97fe3a service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:43.506948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c1c14-2ce0-448b-af88-8b2c5c97fe3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:43.507224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c1c14-2ce0-448b-af88-8b2c5c97fe3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:43.518281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c1c14-2ce0-448b-af88-8b2c5c97fe3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:43.519826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c1c14-2ce0-448b-af88-8b2c5c97fe3a service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:43.532014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1167/2285] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:43.900479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86476643-db30-42c2-8a76-1be21286604a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:43.904965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-86476643-db30-42c2-8a76-1be21286604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:43.928455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86476643-db30-42c2-8a76-1be21286604a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:43.934969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:43.936512 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:43.937056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:43.937507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] PATH_INFO: `/v3/projects/cda145618eb74be0be06c633e547fa6d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:43.939505 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda145618eb74be0be06c633e547fa6d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:43.942684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:44.027970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda145618eb74be0be06c633e547fa6d', 'request_id': 'req-8f01d8ff-85ac-46c6-9c80-13b8a3353019'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.035081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda145618eb74be0be06c633e547fa6d', 'request_id': 'req-8f01d8ff-85ac-46c6-9c80-13b8a3353019'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.047267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda145618eb74be0be06c633e547fa6d', 'request_id': 'req-8f01d8ff-85ac-46c6-9c80-13b8a3353019'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.062957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] The token cache is being invalidate because project cda145618eb74be0be06c633e547fa6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:44.063450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.064380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.066183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1119/2286] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:43 2022] DELETE /identity/v3/projects/cda145618eb74be0be06c633e547fa6d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:29:44.071112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c1c14-2ce0-448b-af88-8b2c5c97fe3a service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:44.081584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c1c14-2ce0-448b-af88-8b2c5c97fe3a service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:44.103648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:44.154311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:44.156168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:44.156577 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:44.156917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] PATH_INFO: `/v3/users/e43f8d25958d49c699afd8a51e0a6198` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:44.159184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43f8d25958d49c699afd8a51e0a6198)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:44.163055 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:44.240652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43f8d25958d49c699afd8a51e0a6198'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.241483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43f8d25958d49c699afd8a51e0a6198'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.242183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43f8d25958d49c699afd8a51e0a6198'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.257615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43f8d25958d49c699afd8a51e0a6198'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.268156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd549f7a-adba-4200-9aa7-601abe025d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43f8d25958d49c699afd8a51e0a6198'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.285443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1168/2287] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:44 2022] DELETE /identity/v3/users/e43f8d25958d49c699afd8a51e0a6198 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:44.673461 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:44.675209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:44.691671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01d8ff-85ac-46c6-9c80-13b8a3353019 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:44.760537 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:44.761453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:44.761729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:44.762032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] PATH_INFO: `/v3/projects/ccda2302ca444d5c80735ac87da8115a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:44.763400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccda2302ca444d5c80735ac87da8115a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:44.765323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:44.802489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:44.824728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccda2302ca444d5c80735ac87da8115a', 'request_id': 'req-f5252e64-f789-49d3-a775-593fe452b0ec'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.831151 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccda2302ca444d5c80735ac87da8115a', 'request_id': 'req-f5252e64-f789-49d3-a775-593fe452b0ec'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.840591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccda2302ca444d5c80735ac87da8115a', 'request_id': 'req-f5252e64-f789-49d3-a775-593fe452b0ec'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.855565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] The token cache is being invalidate because project ccda2302ca444d5c80735ac87da8115a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:44.856036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.857061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f5252e64-f789-49d3-a775-593fe452b0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:44.858991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1120/2288] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:44 2022] DELETE /identity/v3/projects/ccda2302ca444d5c80735ac87da8115a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:29:44.864748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9117d32-3af8-4c66-a9ec-b3c8ddba4f5b None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:44.865115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9117d32-3af8-4c66-a9ec-b3c8ddba4f5b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:44.865406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9117d32-3af8-4c66-a9ec-b3c8ddba4f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:44.886334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b9117d32-3af8-4c66-a9ec-b3c8ddba4f5b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:44.887642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b9117d32-3af8-4c66-a9ec-b3c8ddba4f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:44.959097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1169/2289] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:44.967097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a607d2-cb01-4029-82c1-ee046f8bd72f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:44.967359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a607d2-cb01-4029-82c1-ee046f8bd72f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:44.967651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a607d2-cb01-4029-82c1-ee046f8bd72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:44.987932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-89a607d2-cb01-4029-82c1-ee046f8bd72f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:44.989192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-89a607d2-cb01-4029-82c1-ee046f8bd72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:44.997907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1121/2290] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:45.002638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9117d32-3af8-4c66-a9ec-b3c8ddba4f5b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.013254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9117d32-3af8-4c66-a9ec-b3c8ddba4f5b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.018394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8c6e3-0928-4f81-a5a6-68721eb1cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.019125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8c6e3-0928-4f81-a5a6-68721eb1cd40 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.019410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8c6e3-0928-4f81-a5a6-68721eb1cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.019687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8c6e3-0928-4f81-a5a6-68721eb1cd40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.020441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8c6e3-0928-4f81-a5a6-68721eb1cd40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:29:45.020754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8c6e3-0928-4f81-a5a6-68721eb1cd40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.022441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8c6e3-0928-4f81-a5a6-68721eb1cd40 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.036000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1170/2291] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:29:45.040746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a607d2-cb01-4029-82c1-ee046f8bd72f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.051718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a607d2-cb01-4029-82c1-ee046f8bd72f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.057268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9aac2-6ddc-40f6-98cf-d5bc7b1df286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.057951 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9aac2-6ddc-40f6-98cf-d5bc7b1df286 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.058231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9aac2-6ddc-40f6-98cf-d5bc7b1df286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.058519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9aac2-6ddc-40f6-98cf-d5bc7b1df286 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.059252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9aac2-6ddc-40f6-98cf-d5bc7b1df286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.061259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9aac2-6ddc-40f6-98cf-d5bc7b1df286 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.095421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1122/2292] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:45 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:45.101093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8c6e3-0928-4f81-a5a6-68721eb1cd40 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.119250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8c6e3-0928-4f81-a5a6-68721eb1cd40 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.171188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:45.213401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc1358-1a2e-4122-b698-4d04adc75548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.214465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc1358-1a2e-4122-b698-4d04adc75548 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.214979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc1358-1a2e-4122-b698-4d04adc75548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.215325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc1358-1a2e-4122-b698-4d04adc75548 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.216206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc1358-1a2e-4122-b698-4d04adc75548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.218250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc1358-1a2e-4122-b698-4d04adc75548 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.244544 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1171/2293] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:45 2022] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:45.249273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9aac2-6ddc-40f6-98cf-d5bc7b1df286 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.263999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9aac2-6ddc-40f6-98cf-d5bc7b1df286 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.269496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74054b0b-ff30-4b13-b3ff-6e2fe90f15df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.270189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74054b0b-ff30-4b13-b3ff-6e2fe90f15df admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.270488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74054b0b-ff30-4b13-b3ff-6e2fe90f15df admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.270776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74054b0b-ff30-4b13-b3ff-6e2fe90f15df admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.271532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74054b0b-ff30-4b13-b3ff-6e2fe90f15df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.273170 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74054b0b-ff30-4b13-b3ff-6e2fe90f15df admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.285633 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1123/2294] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:45.290139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc1358-1a2e-4122-b698-4d04adc75548 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.301070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc1358-1a2e-4122-b698-4d04adc75548 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.306249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8493d-2591-4ab9-ace4-06703d07c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.307016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8493d-2591-4ab9-ace4-06703d07c8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.307283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8493d-2591-4ab9-ace4-06703d07c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.307554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8493d-2591-4ab9-ace4-06703d07c8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.308294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8493d-2591-4ab9-ace4-06703d07c8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.309948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8493d-2591-4ab9-ace4-06703d07c8b7 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.322204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1172/2295] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:45.327279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74054b0b-ff30-4b13-b3ff-6e2fe90f15df admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.345113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74054b0b-ff30-4b13-b3ff-6e2fe90f15df admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.352998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b7db5-1b0d-4184-9f34-545926fce3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.354704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b7db5-1b0d-4184-9f34-545926fce3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.355196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b7db5-1b0d-4184-9f34-545926fce3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.355678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b7db5-1b0d-4184-9f34-545926fce3e7 admin admin] PATH_INFO: `/v3/projects/2295148f1b2d43aeb5f22ed00291639c/users/1d4349e378ed4298826ede58bf0df402/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.378726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b7db5-1b0d-4184-9f34-545926fce3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2295148f1b2d43aeb5f22ed00291639c, user_id=1d4349e378ed4298826ede58bf0df402, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.381570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b7db5-1b0d-4184-9f34-545926fce3e7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.399141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1124/2296] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:45 2022] PUT /identity/v3/projects/2295148f1b2d43aeb5f22ed00291639c/users/1d4349e378ed4298826ede58bf0df402/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:45.411370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c2d87-e0c7-4932-a4bd-f7a672280ebc None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.411728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c2d87-e0c7-4932-a4bd-f7a672280ebc None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.411899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c2d87-e0c7-4932-a4bd-f7a672280ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.444194 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d36c2d87-e0c7-4932-a4bd-f7a672280ebc None None] MFA Rules not processed for user `1d4349e378ed4298826ede58bf0df402`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:45.445502 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d36c2d87-e0c7-4932-a4bd-f7a672280ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:45.521857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1173/2297] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:45.529483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b7db5-1b0d-4184-9f34-545926fce3e7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.608107 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b7db5-1b0d-4184-9f34-545926fce3e7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.616922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c2e16-7288-40ee-a906-067c974cc496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.618058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c2e16-7288-40ee-a906-067c974cc496 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.618595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c2e16-7288-40ee-a906-067c974cc496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.619086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c2e16-7288-40ee-a906-067c974cc496 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.620715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c2e16-7288-40ee-a906-067c974cc496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.624530 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c2e16-7288-40ee-a906-067c974cc496 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.666891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1125/2298] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:45 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:45.671817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c2d87-e0c7-4932-a4bd-f7a672280ebc None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.685107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c2d87-e0c7-4932-a4bd-f7a672280ebc None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.755252 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc931-cfd4-4708-9adb-24cd8b0124b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.756043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc931-cfd4-4708-9adb-24cd8b0124b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.756364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc931-cfd4-4708-9adb-24cd8b0124b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.756690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc931-cfd4-4708-9adb-24cd8b0124b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.757537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfc931-cfd4-4708-9adb-24cd8b0124b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.759808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfc931-cfd4-4708-9adb-24cd8b0124b0 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.786029 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1174/2299] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:45 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:45.790668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c2e16-7288-40ee-a906-067c974cc496 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.802646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c2e16-7288-40ee-a906-067c974cc496 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.808419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a68c2a-9457-4eaf-a5a1-826158177880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.809145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a68c2a-9457-4eaf-a5a1-826158177880 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.809433 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a68c2a-9457-4eaf-a5a1-826158177880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.809713 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a68c2a-9457-4eaf-a5a1-826158177880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.810482 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a68c2a-9457-4eaf-a5a1-826158177880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.812226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a68c2a-9457-4eaf-a5a1-826158177880 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.825662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1126/2300] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:45.830361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc931-cfd4-4708-9adb-24cd8b0124b0 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.841846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc931-cfd4-4708-9adb-24cd8b0124b0 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.847959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff5220-1ad3-404f-9d04-286154f4ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.848887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5220-1ad3-404f-9d04-286154f4ba65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.849166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5220-1ad3-404f-9d04-286154f4ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.849438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5220-1ad3-404f-9d04-286154f4ba65 admin admin] PATH_INFO: `/v3/projects/a959ccf788fe43d697ddf8609f32b2cb/users/4874149471c146419bd2b75653cc44b2/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.868580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff5220-1ad3-404f-9d04-286154f4ba65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a959ccf788fe43d697ddf8609f32b2cb, user_id=4874149471c146419bd2b75653cc44b2, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.871322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff5220-1ad3-404f-9d04-286154f4ba65 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.888278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1175/2301] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:45 2022] PUT /identity/v3/projects/a959ccf788fe43d697ddf8609f32b2cb/users/4874149471c146419bd2b75653cc44b2/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:29:45.893035 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a68c2a-9457-4eaf-a5a1-826158177880 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:45.904984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a68c2a-9457-4eaf-a5a1-826158177880 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:45.930012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:45.975917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ee1a9-22fc-41c4-89a8-3ffa92a510eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:45.976613 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee1a9-22fc-41c4-89a8-3ffa92a510eb admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:45.976903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee1a9-22fc-41c4-89a8-3ffa92a510eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:45.977182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee1a9-22fc-41c4-89a8-3ffa92a510eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:45.977927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ee1a9-22fc-41c4-89a8-3ffa92a510eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:45.979668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ee1a9-22fc-41c4-89a8-3ffa92a510eb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:45.992095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1127/2302] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:45.996837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff5220-1ad3-404f-9d04-286154f4ba65 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:46.003134 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:46.011191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff5220-1ad3-404f-9d04-286154f4ba65 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:46.016969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5ef2b-3009-4668-90e0-fda6817319f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:46.018076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5ef2b-3009-4668-90e0-fda6817319f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:46.018451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5ef2b-3009-4668-90e0-fda6817319f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:46.018862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5ef2b-3009-4668-90e0-fda6817319f1 admin admin] PATH_INFO: `/v3/projects/a959ccf788fe43d697ddf8609f32b2cb/users/4874149471c146419bd2b75653cc44b2/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:46.021187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5ef2b-3009-4668-90e0-fda6817319f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a959ccf788fe43d697ddf8609f32b2cb, user_id=4874149471c146419bd2b75653cc44b2, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:46.024076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5ef2b-3009-4668-90e0-fda6817319f1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:46.036957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1176/2303] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:45 2022] PUT /identity/v3/projects/a959ccf788fe43d697ddf8609f32b2cb/users/4874149471c146419bd2b75653cc44b2/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:46.047630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205e8ba-c961-46f9-a1ef-8675bdba3ac9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:46.047969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205e8ba-c961-46f9-a1ef-8675bdba3ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:46.048300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205e8ba-c961-46f9-a1ef-8675bdba3ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:46.080455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8205e8ba-c961-46f9-a1ef-8675bdba3ac9 None None] MFA Rules not processed for user `4874149471c146419bd2b75653cc44b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:46.081730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8205e8ba-c961-46f9-a1ef-8675bdba3ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:46.168929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1128/2304] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:46.181745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5ef2b-3009-4668-90e0-fda6817319f1 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:46.183978 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2fb5ef2b-3009-4668-90e0-fda6817319f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:46.252344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5ef2b-3009-4668-90e0-fda6817319f1 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:46.256589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d86c8-a9c6-4360-899a-1d410eae05d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:46.257273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d86c8-a9c6-4360-899a-1d410eae05d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:46.257558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d86c8-a9c6-4360-899a-1d410eae05d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:46.257846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d86c8-a9c6-4360-899a-1d410eae05d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:46.268812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d86c8-a9c6-4360-899a-1d410eae05d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:46.270303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d86c8-a9c6-4360-899a-1d410eae05d4 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:46.281823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1177/2305] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:46.368246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205e8ba-c961-46f9-a1ef-8675bdba3ac9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:46.379476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205e8ba-c961-46f9-a1ef-8675bdba3ac9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:46.383690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3cac8-66ac-457f-82ae-0add0dc2224c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:46.384358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3cac8-66ac-457f-82ae-0add0dc2224c service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:46.384643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3cac8-66ac-457f-82ae-0add0dc2224c service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:46.384922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3cac8-66ac-457f-82ae-0add0dc2224c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:46.457023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3cac8-66ac-457f-82ae-0add0dc2224c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:46.458418 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3cac8-66ac-457f-82ae-0add0dc2224c service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:46.469242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1129/2306] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:49.400715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d86c8-a9c6-4360-899a-1d410eae05d4 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:49.477471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d86c8-a9c6-4360-899a-1d410eae05d4 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:49.482644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:49.483573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:49.483863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:49.484139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] PATH_INFO: `/v3/users/1d4349e378ed4298826ede58bf0df402` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:49.485513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4349e378ed4298826ede58bf0df402)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:49.487751 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:49.546888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4349e378ed4298826ede58bf0df402'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:49.547677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4349e378ed4298826ede58bf0df402'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:49.548392 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4349e378ed4298826ede58bf0df402'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:49.565189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4349e378ed4298826ede58bf0df402'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:49.576520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4349e378ed4298826ede58bf0df402'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:49.600278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1178/2307] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:49 2022] DELETE /identity/v3/users/1d4349e378ed4298826ede58bf0df402 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:49.605528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c76ec-8d29-457d-8ca9-24d195ea37fa None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:49.606463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c76ec-8d29-457d-8ca9-24d195ea37fa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:49.606463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c76ec-8d29-457d-8ca9-24d195ea37fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:49.627991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-435c76ec-8d29-457d-8ca9-24d195ea37fa None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:49.629183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-435c76ec-8d29-457d-8ca9-24d195ea37fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:49.676925 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:49.697533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1130/2308] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:49.708351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:49.709954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:49.726003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:49.781007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d7f4-2aa8-46df-999a-ed634111a336 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:49.786067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba21c44-0c1e-4381-982e-ac223471f926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:49.786909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba21c44-0c1e-4381-982e-ac223471f926 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:49.787853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba21c44-0c1e-4381-982e-ac223471f926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:49.787853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba21c44-0c1e-4381-982e-ac223471f926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:49.799285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba21c44-0c1e-4381-982e-ac223471f926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:49.800780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba21c44-0c1e-4381-982e-ac223471f926 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:49.813389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1179/2309] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:50.147006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c76ec-8d29-457d-8ca9-24d195ea37fa None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:50.148688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-435c76ec-8d29-457d-8ca9-24d195ea37fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:50.162644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c76ec-8d29-457d-8ca9-24d195ea37fa None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:50.167968 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:50.168878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:50.169182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:50.169463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] PATH_INFO: `/v3/projects/2295148f1b2d43aeb5f22ed00291639c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:50.170909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2295148f1b2d43aeb5f22ed00291639c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:50.172895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:50.232331 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2295148f1b2d43aeb5f22ed00291639c', 'request_id': 'req-25660793-28d7-4bd1-aea0-cacca1eca134'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.242247 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2295148f1b2d43aeb5f22ed00291639c', 'request_id': 'req-25660793-28d7-4bd1-aea0-cacca1eca134'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.254250 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2295148f1b2d43aeb5f22ed00291639c', 'request_id': 'req-25660793-28d7-4bd1-aea0-cacca1eca134'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.275059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] The token cache is being invalidate because project 2295148f1b2d43aeb5f22ed00291639c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:50.275559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.276651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.279728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1131/2310] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:50 2022] DELETE /identity/v3/projects/2295148f1b2d43aeb5f22ed00291639c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:29:50.285726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba21c44-0c1e-4381-982e-ac223471f926 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:50.302954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba21c44-0c1e-4381-982e-ac223471f926 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:50.393152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:50.394120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:50.394402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:50.394716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] PATH_INFO: `/v3/users/4874149471c146419bd2b75653cc44b2` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:50.396081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4874149471c146419bd2b75653cc44b2)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:50.398062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:50.457012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4874149471c146419bd2b75653cc44b2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.457791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4874149471c146419bd2b75653cc44b2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.458525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4874149471c146419bd2b75653cc44b2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.473931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4874149471c146419bd2b75653cc44b2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.483963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3c8816a0-4be1-482c-93d7-afe4d333871a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4874149471c146419bd2b75653cc44b2'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.507192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1180/2311] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:50 2022] DELETE /identity/v3/users/4874149471c146419bd2b75653cc44b2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:50.871766 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:50.874114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:50.894027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25660793-28d7-4bd1-aea0-cacca1eca134 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:50.967370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:50.968296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:50.968574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:50.968842 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] PATH_INFO: `/v3/projects/a959ccf788fe43d697ddf8609f32b2cb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:50.970158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a959ccf788fe43d697ddf8609f32b2cb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:50.972165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.036039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a959ccf788fe43d697ddf8609f32b2cb', 'request_id': 'req-adf86d48-35ad-410c-a211-3a930b09b6d3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:51.042452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a959ccf788fe43d697ddf8609f32b2cb', 'request_id': 'req-adf86d48-35ad-410c-a211-3a930b09b6d3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:51.052499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a959ccf788fe43d697ddf8609f32b2cb', 'request_id': 'req-adf86d48-35ad-410c-a211-3a930b09b6d3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:51.066411 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:51.075867 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] The token cache is being invalidate because project a959ccf788fe43d697ddf8609f32b2cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:51.076383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:51.078408 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf86d48-35ad-410c-a211-3a930b09b6d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:51.081628 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1132/2312] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:50 2022] DELETE /identity/v3/projects/a959ccf788fe43d697ddf8609f32b2cb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:51.086807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3062d-5cd6-4c3d-a1f6-d99ca0e61960 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.087097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3062d-5cd6-4c3d-a1f6-d99ca0e61960 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.087381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3062d-5cd6-4c3d-a1f6-d99ca0e61960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.116430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-43c3062d-5cd6-4c3d-a1f6-d99ca0e61960 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:51.118606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-43c3062d-5cd6-4c3d-a1f6-d99ca0e61960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:51.170902 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:51.210328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1181/2313] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:29:51.220330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679b6f0-ecb5-4089-8210-ea3da7412f66 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.220972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679b6f0-ecb5-4089-8210-ea3da7412f66 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.221478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679b6f0-ecb5-4089-8210-ea3da7412f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.253441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5679b6f0-ecb5-4089-8210-ea3da7412f66 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:51.255581 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5679b6f0-ecb5-4089-8210-ea3da7412f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:51.269888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1133/2314] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:51.274924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3062d-5cd6-4c3d-a1f6-d99ca0e61960 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.286802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3062d-5cd6-4c3d-a1f6-d99ca0e61960 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.293221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76820136-65fb-4b53-b44d-6072b195967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.294083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76820136-65fb-4b53-b44d-6072b195967f admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.294445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76820136-65fb-4b53-b44d-6072b195967f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.294815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76820136-65fb-4b53-b44d-6072b195967f admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.295623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76820136-65fb-4b53-b44d-6072b195967f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:29:51.296013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76820136-65fb-4b53-b44d-6072b195967f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.297798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76820136-65fb-4b53-b44d-6072b195967f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.312693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1182/2315] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:29:51.319130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679b6f0-ecb5-4089-8210-ea3da7412f66 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.329164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679b6f0-ecb5-4089-8210-ea3da7412f66 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.335194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24566c-f588-4c0d-bbc1-170a146c11fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.335887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24566c-f588-4c0d-bbc1-170a146c11fb admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.336166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24566c-f588-4c0d-bbc1-170a146c11fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.336434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24566c-f588-4c0d-bbc1-170a146c11fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.337163 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24566c-f588-4c0d-bbc1-170a146c11fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.339334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24566c-f588-4c0d-bbc1-170a146c11fb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.371642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1134/2316] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:51.376436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76820136-65fb-4b53-b44d-6072b195967f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.387996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76820136-65fb-4b53-b44d-6072b195967f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.457917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14425-46e2-45ef-a4ea-cfaa7212f82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.458617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14425-46e2-45ef-a4ea-cfaa7212f82a admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.458891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14425-46e2-45ef-a4ea-cfaa7212f82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.459165 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14425-46e2-45ef-a4ea-cfaa7212f82a admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.459882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d14425-46e2-45ef-a4ea-cfaa7212f82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.461893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d14425-46e2-45ef-a4ea-cfaa7212f82a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.485074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1183/2317] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:51.489743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24566c-f588-4c0d-bbc1-170a146c11fb admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.501643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24566c-f588-4c0d-bbc1-170a146c11fb admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.507093 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e154a1b-ac30-4798-8b47-69de8898ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.507772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e154a1b-ac30-4798-8b47-69de8898ab6e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.508063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e154a1b-ac30-4798-8b47-69de8898ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.508330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e154a1b-ac30-4798-8b47-69de8898ab6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.509058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e154a1b-ac30-4798-8b47-69de8898ab6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.510738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e154a1b-ac30-4798-8b47-69de8898ab6e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.524044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1135/2318] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:51.529291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14425-46e2-45ef-a4ea-cfaa7212f82a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.540761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14425-46e2-45ef-a4ea-cfaa7212f82a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.546399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06763019-5e1e-49bf-8106-f04b7e3b9a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.547197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06763019-5e1e-49bf-8106-f04b7e3b9a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.547754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06763019-5e1e-49bf-8106-f04b7e3b9a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.547899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06763019-5e1e-49bf-8106-f04b7e3b9a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.548963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06763019-5e1e-49bf-8106-f04b7e3b9a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.550792 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06763019-5e1e-49bf-8106-f04b7e3b9a4c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.563423 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1184/2319] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:51.568240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e154a1b-ac30-4798-8b47-69de8898ab6e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.579529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e154a1b-ac30-4798-8b47-69de8898ab6e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.585132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec75b0d-93b7-44b6-a918-813b89cc2471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.586049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75b0d-93b7-44b6-a918-813b89cc2471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.586331 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75b0d-93b7-44b6-a918-813b89cc2471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.586646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75b0d-93b7-44b6-a918-813b89cc2471 admin admin] PATH_INFO: `/v3/projects/1a1ad367d26241b1aa487bea7725ad43/users/9a334212ba4840249099d4d02800b162/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.606212 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec75b0d-93b7-44b6-a918-813b89cc2471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1ad367d26241b1aa487bea7725ad43, user_id=9a334212ba4840249099d4d02800b162, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.609056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec75b0d-93b7-44b6-a918-813b89cc2471 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.626194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1136/2320] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:51 2022] PUT /identity/v3/projects/1a1ad367d26241b1aa487bea7725ad43/users/9a334212ba4840249099d4d02800b162/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:29:51.639572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868de4-460f-4be6-8696-384f584136b3 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.640222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868de4-460f-4be6-8696-384f584136b3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.640770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868de4-460f-4be6-8696-384f584136b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.689734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-be868de4-460f-4be6-8696-384f584136b3 None None] MFA Rules not processed for user `9a334212ba4840249099d4d02800b162`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:51.691920 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-be868de4-460f-4be6-8696-384f584136b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:51.806525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1185/2321] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:51.811875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec75b0d-93b7-44b6-a918-813b89cc2471 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.886349 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec75b0d-93b7-44b6-a918-813b89cc2471 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.894820 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd4b87-c963-49f0-88ae-5eb9a42c8c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.895930 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd4b87-c963-49f0-88ae-5eb9a42c8c31 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.896401 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd4b87-c963-49f0-88ae-5eb9a42c8c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.896879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd4b87-c963-49f0-88ae-5eb9a42c8c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.898193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd4b87-c963-49f0-88ae-5eb9a42c8c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.902015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd4b87-c963-49f0-88ae-5eb9a42c8c31 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.938845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1137/2322] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:51.943600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868de4-460f-4be6-8696-384f584136b3 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.958042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868de4-460f-4be6-8696-384f584136b3 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.991801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:52.041004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2467a-c3a1-43d0-8887-f40812f4c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:52.041724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2467a-c3a1-43d0-8887-f40812f4c1cf admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:52.042020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2467a-c3a1-43d0-8887-f40812f4c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:52.042296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2467a-c3a1-43d0-8887-f40812f4c1cf admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:52.043082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2467a-c3a1-43d0-8887-f40812f4c1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:52.045150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2467a-c3a1-43d0-8887-f40812f4c1cf admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:52.070219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1186/2323] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:52.074697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd4b87-c963-49f0-88ae-5eb9a42c8c31 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:52.086557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd4b87-c963-49f0-88ae-5eb9a42c8c31 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:52.092612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d223b28-d5e7-4a95-a63d-cac4519dfa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:52.093329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d223b28-d5e7-4a95-a63d-cac4519dfa86 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:52.093607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d223b28-d5e7-4a95-a63d-cac4519dfa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:52.093884 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d223b28-d5e7-4a95-a63d-cac4519dfa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:52.094660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d223b28-d5e7-4a95-a63d-cac4519dfa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:52.096462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d223b28-d5e7-4a95-a63d-cac4519dfa86 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:52.109521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1138/2324] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:52.115162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2467a-c3a1-43d0-8887-f40812f4c1cf admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:52.128228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2467a-c3a1-43d0-8887-f40812f4c1cf admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:52.133982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180c9d-1407-4fce-8a93-3380e2bceac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:52.135016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180c9d-1407-4fce-8a93-3380e2bceac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:52.135298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180c9d-1407-4fce-8a93-3380e2bceac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:52.135579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180c9d-1407-4fce-8a93-3380e2bceac6 admin admin] PATH_INFO: `/v3/projects/f7325b1b936e43afaf66921a988c135a/users/13cbf540de044ff4ad1052a16accabc1/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:52.154919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180c9d-1407-4fce-8a93-3380e2bceac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7325b1b936e43afaf66921a988c135a, user_id=13cbf540de044ff4ad1052a16accabc1, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:52.157982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180c9d-1407-4fce-8a93-3380e2bceac6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:52.173575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1187/2325] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:52 2022] PUT /identity/v3/projects/f7325b1b936e43afaf66921a988c135a/users/13cbf540de044ff4ad1052a16accabc1/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:52.178110 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d223b28-d5e7-4a95-a63d-cac4519dfa86 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:52.189479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d223b28-d5e7-4a95-a63d-cac4519dfa86 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:52.262335 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62250e9-d3f0-4753-be22-096616f74d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:52.263118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62250e9-d3f0-4753-be22-096616f74d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:52.263402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62250e9-d3f0-4753-be22-096616f74d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:52.263700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62250e9-d3f0-4753-be22-096616f74d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:52.264763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62250e9-d3f0-4753-be22-096616f74d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:52.266984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62250e9-d3f0-4753-be22-096616f74d88 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:52.279770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1139/2326] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:52.284292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180c9d-1407-4fce-8a93-3380e2bceac6 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:52.295661 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180c9d-1407-4fce-8a93-3380e2bceac6 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:52.301457 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85192693-6bb8-497e-881e-691a6f9c5a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:52.302682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85192693-6bb8-497e-881e-691a6f9c5a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:52.302837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85192693-6bb8-497e-881e-691a6f9c5a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:52.303096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85192693-6bb8-497e-881e-691a6f9c5a56 admin admin] PATH_INFO: `/v3/projects/f7325b1b936e43afaf66921a988c135a/users/13cbf540de044ff4ad1052a16accabc1/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:52.305512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85192693-6bb8-497e-881e-691a6f9c5a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7325b1b936e43afaf66921a988c135a, user_id=13cbf540de044ff4ad1052a16accabc1, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:52.308390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85192693-6bb8-497e-881e-691a6f9c5a56 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:52.321701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1188/2327] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:52 2022] PUT /identity/v3/projects/f7325b1b936e43afaf66921a988c135a/users/13cbf540de044ff4ad1052a16accabc1/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:52.333630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58922c5-20db-4446-bc4c-60de50b58395 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:52.333915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58922c5-20db-4446-bc4c-60de50b58395 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:52.334221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58922c5-20db-4446-bc4c-60de50b58395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:52.342085 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:52.366558 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a58922c5-20db-4446-bc4c-60de50b58395 None None] MFA Rules not processed for user `13cbf540de044ff4ad1052a16accabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:52.367897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a58922c5-20db-4446-bc4c-60de50b58395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:52.449717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1140/2328] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:29:52.471294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85192693-6bb8-497e-881e-691a6f9c5a56 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:52.473411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-85192693-6bb8-497e-881e-691a6f9c5a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:52.548901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85192693-6bb8-497e-881e-691a6f9c5a56 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:52.554887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c332e81-4eec-47c6-b8b1-0a4cf629329f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:52.555584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c332e81-4eec-47c6-b8b1-0a4cf629329f service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:52.555861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c332e81-4eec-47c6-b8b1-0a4cf629329f service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:52.556131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c332e81-4eec-47c6-b8b1-0a4cf629329f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:52.567272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c332e81-4eec-47c6-b8b1-0a4cf629329f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:52.568799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c332e81-4eec-47c6-b8b1-0a4cf629329f service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:52.581551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1189/2329] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:29:52.668305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58922c5-20db-4446-bc4c-60de50b58395 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:52.745750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58922c5-20db-4446-bc4c-60de50b58395 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:52.751083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:52.752214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:52.752499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:52.752807 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] PATH_INFO: `/v3/users/9a334212ba4840249099d4d02800b162` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:52.754317 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a334212ba4840249099d4d02800b162)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:52.756493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:52.818153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a334212ba4840249099d4d02800b162'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:52.832322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a334212ba4840249099d4d02800b162'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:52.833235 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a334212ba4840249099d4d02800b162'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:52.848705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a334212ba4840249099d4d02800b162'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:52.856963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a334212ba4840249099d4d02800b162'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:52.863899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1141/2330] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:52 2022] DELETE /identity/v3/users/9a334212ba4840249099d4d02800b162 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:52.874348 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a26d9-37b8-44e4-a1c8-9c8349949dd2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:52.874746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a26d9-37b8-44e4-a1c8-9c8349949dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:52.875043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a26d9-37b8-44e4-a1c8-9c8349949dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:52.894877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-528a26d9-37b8-44e4-a1c8-9c8349949dd2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:52.896163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-528a26d9-37b8-44e4-a1c8-9c8349949dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:52.973622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1190/2331] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:52.985948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:52.987534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:53.000420 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:53.061274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ec7d1-df02-4c80-9a61-91c15024bac1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:53.065778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9b918-b0ad-487c-8386-dd0094e1e298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:53.066474 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9b918-b0ad-487c-8386-dd0094e1e298 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:53.066833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9b918-b0ad-487c-8386-dd0094e1e298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:53.067105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9b918-b0ad-487c-8386-dd0094e1e298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:53.078305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9b918-b0ad-487c-8386-dd0094e1e298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:53.079854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9b918-b0ad-487c-8386-dd0094e1e298 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:53.092157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1142/2332] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:53.442488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a26d9-37b8-44e4-a1c8-9c8349949dd2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:53.444807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-528a26d9-37b8-44e4-a1c8-9c8349949dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:53.464362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a26d9-37b8-44e4-a1c8-9c8349949dd2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:53.470797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:53.471936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:53.472926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:53.472926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] PATH_INFO: `/v3/projects/1a1ad367d26241b1aa487bea7725ad43` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:53.474992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1ad367d26241b1aa487bea7725ad43)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:53.477835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:53.506567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:53.541459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1ad367d26241b1aa487bea7725ad43', 'request_id': 'req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:53.552034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1ad367d26241b1aa487bea7725ad43', 'request_id': 'req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:53.560103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1ad367d26241b1aa487bea7725ad43', 'request_id': 'req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:53.573429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] The token cache is being invalidate because project 1a1ad367d26241b1aa487bea7725ad43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:53.573855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:53.574726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:53.576465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1191/2333] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:53 2022] DELETE /identity/v3/projects/1a1ad367d26241b1aa487bea7725ad43 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:53.581270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9b918-b0ad-487c-8386-dd0094e1e298 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:53.592157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9b918-b0ad-487c-8386-dd0094e1e298 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:53.670049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:53.671007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:53.671278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:53.671550 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] PATH_INFO: `/v3/users/13cbf540de044ff4ad1052a16accabc1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:53.672932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cbf540de044ff4ad1052a16accabc1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:53.675076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:53.740465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cbf540de044ff4ad1052a16accabc1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:53.751492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cbf540de044ff4ad1052a16accabc1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:53.752579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cbf540de044ff4ad1052a16accabc1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:53.771440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cbf540de044ff4ad1052a16accabc1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:53.785140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9b1e575c-b246-485b-8208-972128ccf840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cbf540de044ff4ad1052a16accabc1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:53.795688 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1143/2334] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:53 2022] DELETE /identity/v3/users/13cbf540de044ff4ad1052a16accabc1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:54.156090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:54.157625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:54.172150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6fe8-2e6d-4872-880a-f09bd3fd6231 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:54.244758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:54.245761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:54.246051 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:54.246340 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] PATH_INFO: `/v3/projects/f7325b1b936e43afaf66921a988c135a` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:54.247701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7325b1b936e43afaf66921a988c135a)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:54.249905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:54.308034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7325b1b936e43afaf66921a988c135a', 'request_id': 'req-dcc94557-2199-4612-8330-79952f531fc5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:54.316861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7325b1b936e43afaf66921a988c135a', 'request_id': 'req-dcc94557-2199-4612-8330-79952f531fc5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:54.324579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7325b1b936e43afaf66921a988c135a', 'request_id': 'req-dcc94557-2199-4612-8330-79952f531fc5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:54.337442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] The token cache is being invalidate because project f7325b1b936e43afaf66921a988c135a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:54.337734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:54.338552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dcc94557-2199-4612-8330-79952f531fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:54.340278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1192/2335] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:54 2022] DELETE /identity/v3/projects/f7325b1b936e43afaf66921a988c135a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:29:54.345566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80de42-2acd-402a-887d-018b4eaa327e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:54.346103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80de42-2acd-402a-887d-018b4eaa327e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:54.346209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80de42-2acd-402a-887d-018b4eaa327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:54.366304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2c80de42-2acd-402a-887d-018b4eaa327e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:54.367599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2c80de42-2acd-402a-887d-018b4eaa327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:54.397405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:54.439832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1144/2336] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:54.448365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e362bc-4e74-4a38-93e7-61b9ac6446b6 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:54.448634 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e362bc-4e74-4a38-93e7-61b9ac6446b6 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:54.448898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e362bc-4e74-4a38-93e7-61b9ac6446b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:54.470490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e2e362bc-4e74-4a38-93e7-61b9ac6446b6 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:54.471789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e2e362bc-4e74-4a38-93e7-61b9ac6446b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:54.482098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1193/2337] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:54.487162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80de42-2acd-402a-887d-018b4eaa327e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:54.497866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80de42-2acd-402a-887d-018b4eaa327e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:54.503299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9988b-dbdc-4122-9376-635153e52c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:54.503976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9988b-dbdc-4122-9376-635153e52c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:54.504256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9988b-dbdc-4122-9376-635153e52c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:54.504555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9988b-dbdc-4122-9376-635153e52c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:54.505324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9988b-dbdc-4122-9376-635153e52c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:29:54.505630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9988b-dbdc-4122-9376-635153e52c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:54.507328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9988b-dbdc-4122-9376-635153e52c24 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:54.523212 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1145/2338] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:29:54.530120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e362bc-4e74-4a38-93e7-61b9ac6446b6 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:54.540324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e362bc-4e74-4a38-93e7-61b9ac6446b6 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:54.545373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abdbd6-b34d-4fbb-a326-ad4cd7f72b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:54.546083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abdbd6-b34d-4fbb-a326-ad4cd7f72b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:54.546355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abdbd6-b34d-4fbb-a326-ad4cd7f72b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:54.546675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abdbd6-b34d-4fbb-a326-ad4cd7f72b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:54.547403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abdbd6-b34d-4fbb-a326-ad4cd7f72b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:54.550036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abdbd6-b34d-4fbb-a326-ad4cd7f72b21 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:54.587811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1194/2339] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:54 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:29:54.594300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9988b-dbdc-4122-9376-635153e52c24 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:54.605676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9988b-dbdc-4122-9376-635153e52c24 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:54.674479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05db7c-b18d-4f47-9881-0915eaa1ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:54.675208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05db7c-b18d-4f47-9881-0915eaa1ea72 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:54.675489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05db7c-b18d-4f47-9881-0915eaa1ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:54.675770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05db7c-b18d-4f47-9881-0915eaa1ea72 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:54.676467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05db7c-b18d-4f47-9881-0915eaa1ea72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:54.678661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05db7c-b18d-4f47-9881-0915eaa1ea72 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:54.702325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1146/2340] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:54 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:54.707568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abdbd6-b34d-4fbb-a326-ad4cd7f72b21 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:54.719435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abdbd6-b34d-4fbb-a326-ad4cd7f72b21 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:54.725223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa804359-ce8c-438e-a952-8a8927097771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:54.726004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa804359-ce8c-438e-a952-8a8927097771 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:54.726397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa804359-ce8c-438e-a952-8a8927097771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:54.726856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa804359-ce8c-438e-a952-8a8927097771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:54.727698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa804359-ce8c-438e-a952-8a8927097771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:54.729859 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa804359-ce8c-438e-a952-8a8927097771 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:54.732832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:54.746295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1195/2341] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:54.750711 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05db7c-b18d-4f47-9881-0915eaa1ea72 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:54.762535 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05db7c-b18d-4f47-9881-0915eaa1ea72 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:54.768586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276438d5-4eb9-4b7d-ad6d-596b8d74c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:54.769342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276438d5-4eb9-4b7d-ad6d-596b8d74c829 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:54.769665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276438d5-4eb9-4b7d-ad6d-596b8d74c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:54.770018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276438d5-4eb9-4b7d-ad6d-596b8d74c829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:54.770932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276438d5-4eb9-4b7d-ad6d-596b8d74c829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:54.772638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276438d5-4eb9-4b7d-ad6d-596b8d74c829 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:54.785076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1147/2342] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:54.789673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa804359-ce8c-438e-a952-8a8927097771 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:54.801188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa804359-ce8c-438e-a952-8a8927097771 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:54.806635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9d820-aab3-4c99-a0fb-78ba63584753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:54.807575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9d820-aab3-4c99-a0fb-78ba63584753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:54.807849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9d820-aab3-4c99-a0fb-78ba63584753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:54.808121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9d820-aab3-4c99-a0fb-78ba63584753 admin admin] PATH_INFO: `/v3/projects/e83c6827c69746c0bd8c46d6e0f9c88d/users/2622a96ef92b440092e79242fd7105fa/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:54.825735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9d820-aab3-4c99-a0fb-78ba63584753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83c6827c69746c0bd8c46d6e0f9c88d, user_id=2622a96ef92b440092e79242fd7105fa, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:54.828549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9d820-aab3-4c99-a0fb-78ba63584753 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:54.845147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1196/2343] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:54 2022] PUT /identity/v3/projects/e83c6827c69746c0bd8c46d6e0f9c88d/users/2622a96ef92b440092e79242fd7105fa/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:54.858463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998410b2-5acd-4a8f-912e-082e67bc3336 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:54.859221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998410b2-5acd-4a8f-912e-082e67bc3336 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:54.859694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998410b2-5acd-4a8f-912e-082e67bc3336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:54.900681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-998410b2-5acd-4a8f-912e-082e67bc3336 None None] MFA Rules not processed for user `2622a96ef92b440092e79242fd7105fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:54.901941 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-998410b2-5acd-4a8f-912e-082e67bc3336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:54.979497 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1148/2344] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:54.984195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9d820-aab3-4c99-a0fb-78ba63584753 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.054297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9d820-aab3-4c99-a0fb-78ba63584753 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.060100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f2513-45c7-4cef-a9e8-c02fd3dd642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.060843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f2513-45c7-4cef-a9e8-c02fd3dd642d admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.061160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f2513-45c7-4cef-a9e8-c02fd3dd642d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.061539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f2513-45c7-4cef-a9e8-c02fd3dd642d admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.062537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f2513-45c7-4cef-a9e8-c02fd3dd642d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.064875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f2513-45c7-4cef-a9e8-c02fd3dd642d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.095180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1197/2345] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:54 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:55.099528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998410b2-5acd-4a8f-912e-082e67bc3336 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.111195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998410b2-5acd-4a8f-912e-082e67bc3336 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.139382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:55.181903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a44fa6-a2aa-48b9-a1bf-053f6af8c888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.182728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44fa6-a2aa-48b9-a1bf-053f6af8c888 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.183058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44fa6-a2aa-48b9-a1bf-053f6af8c888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.183405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44fa6-a2aa-48b9-a1bf-053f6af8c888 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.184164 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a44fa6-a2aa-48b9-a1bf-053f6af8c888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.186266 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a44fa6-a2aa-48b9-a1bf-053f6af8c888 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.212014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1149/2346] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:55 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:55.216837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f2513-45c7-4cef-a9e8-c02fd3dd642d admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.228860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f2513-45c7-4cef-a9e8-c02fd3dd642d admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.235047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d98ebd-f594-4bed-94c3-1bd864c80089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.235678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d98ebd-f594-4bed-94c3-1bd864c80089 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.235963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d98ebd-f594-4bed-94c3-1bd864c80089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.236290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d98ebd-f594-4bed-94c3-1bd864c80089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.237063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d98ebd-f594-4bed-94c3-1bd864c80089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.238780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d98ebd-f594-4bed-94c3-1bd864c80089 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.251229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1198/2347] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:29:55.256359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a44fa6-a2aa-48b9-a1bf-053f6af8c888 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.268367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a44fa6-a2aa-48b9-a1bf-053f6af8c888 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.273734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b79f0e-d0bd-421b-9bd4-677f2a763803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.274452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79f0e-d0bd-421b-9bd4-677f2a763803 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.274992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79f0e-d0bd-421b-9bd4-677f2a763803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.275306 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79f0e-d0bd-421b-9bd4-677f2a763803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.276206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b79f0e-d0bd-421b-9bd4-677f2a763803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.279324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b79f0e-d0bd-421b-9bd4-677f2a763803 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.291552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1150/2348] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:55.297957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d98ebd-f594-4bed-94c3-1bd864c80089 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.310310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d98ebd-f594-4bed-94c3-1bd864c80089 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.315599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbb447-468b-48a8-937c-8431b050dcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.316555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbb447-468b-48a8-937c-8431b050dcac admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.316834 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbb447-468b-48a8-937c-8431b050dcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.317123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbb447-468b-48a8-937c-8431b050dcac admin admin] PATH_INFO: `/v3/projects/355e8f82ba42414380606ee92b1a3d8c/users/2564c77952744d91b0c2116a81997560/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.334231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbb447-468b-48a8-937c-8431b050dcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=355e8f82ba42414380606ee92b1a3d8c, user_id=2564c77952744d91b0c2116a81997560, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.337071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbb447-468b-48a8-937c-8431b050dcac admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.355556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1199/2349] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:55 2022] PUT /identity/v3/projects/355e8f82ba42414380606ee92b1a3d8c/users/2564c77952744d91b0c2116a81997560/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:55.372748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313a7f-61c0-4946-af41-3c64190eefb4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.373598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313a7f-61c0-4946-af41-3c64190eefb4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.373598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313a7f-61c0-4946-af41-3c64190eefb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.406569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-77313a7f-61c0-4946-af41-3c64190eefb4 None None] MFA Rules not processed for user `2564c77952744d91b0c2116a81997560`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:55.407953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-77313a7f-61c0-4946-af41-3c64190eefb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:55.484671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1151/2350] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:55.489716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbb447-468b-48a8-937c-8431b050dcac admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.571686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbb447-468b-48a8-937c-8431b050dcac admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.576898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0acb7-c12e-4794-8112-53f475434472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.577598 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0acb7-c12e-4794-8112-53f475434472 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.577880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0acb7-c12e-4794-8112-53f475434472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.578156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0acb7-c12e-4794-8112-53f475434472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.578929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0acb7-c12e-4794-8112-53f475434472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.580984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0acb7-c12e-4794-8112-53f475434472 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.613052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1200/2351] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:55 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:55.618202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77313a7f-61c0-4946-af41-3c64190eefb4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.631710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77313a7f-61c0-4946-af41-3c64190eefb4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.701321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c204bc-e002-46d2-b70e-9cae053d2581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.702135 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c204bc-e002-46d2-b70e-9cae053d2581 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.702457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c204bc-e002-46d2-b70e-9cae053d2581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.702823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c204bc-e002-46d2-b70e-9cae053d2581 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.703589 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c204bc-e002-46d2-b70e-9cae053d2581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.705844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c204bc-e002-46d2-b70e-9cae053d2581 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.733479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1152/2352] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:55 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:29:55.738107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0acb7-c12e-4794-8112-53f475434472 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.749733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0acb7-c12e-4794-8112-53f475434472 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.754750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79738cc0-3fe7-403b-924f-86780f07a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.755430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79738cc0-3fe7-403b-924f-86780f07a6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.755719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79738cc0-3fe7-403b-924f-86780f07a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.756010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79738cc0-3fe7-403b-924f-86780f07a6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.756816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79738cc0-3fe7-403b-924f-86780f07a6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.758620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79738cc0-3fe7-403b-924f-86780f07a6a1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.761444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:55.772049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1201/2353] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:55.778069 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c204bc-e002-46d2-b70e-9cae053d2581 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.789379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c204bc-e002-46d2-b70e-9cae053d2581 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.795577 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba446e-ba86-4f76-9322-97c837b06348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.796697 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba446e-ba86-4f76-9322-97c837b06348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.797180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba446e-ba86-4f76-9322-97c837b06348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.797575 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba446e-ba86-4f76-9322-97c837b06348 admin admin] PATH_INFO: `/v3/projects/b247c4feffdd41dcb617dd5c6df76327/users/40feb3a750524e5c9f7f4a9e161ac717/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.815795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba446e-ba86-4f76-9322-97c837b06348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b247c4feffdd41dcb617dd5c6df76327, user_id=40feb3a750524e5c9f7f4a9e161ac717, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.818638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba446e-ba86-4f76-9322-97c837b06348 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.831500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:55.840412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1153/2354] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:55 2022] PUT /identity/v3/projects/b247c4feffdd41dcb617dd5c6df76327/users/40feb3a750524e5c9f7f4a9e161ac717/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:55.845827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79738cc0-3fe7-403b-924f-86780f07a6a1 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.857044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79738cc0-3fe7-403b-924f-86780f07a6a1 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.925109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247bc67-f68b-4f21-a709-215a93e2935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.925813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247bc67-f68b-4f21-a709-215a93e2935d admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.926104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247bc67-f68b-4f21-a709-215a93e2935d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.926388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247bc67-f68b-4f21-a709-215a93e2935d admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.927223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247bc67-f68b-4f21-a709-215a93e2935d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.928909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247bc67-f68b-4f21-a709-215a93e2935d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.941006 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1202/2355] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:55.945870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba446e-ba86-4f76-9322-97c837b06348 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:55.957615 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba446e-ba86-4f76-9322-97c837b06348 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:55.963194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e56fc-ce6d-4adf-aa86-87ee2919ff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:55.964103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e56fc-ce6d-4adf-aa86-87ee2919ff0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.964381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e56fc-ce6d-4adf-aa86-87ee2919ff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.964655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e56fc-ce6d-4adf-aa86-87ee2919ff0f admin admin] PATH_INFO: `/v3/projects/b247c4feffdd41dcb617dd5c6df76327/users/40feb3a750524e5c9f7f4a9e161ac717/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:55.966913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e56fc-ce6d-4adf-aa86-87ee2919ff0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b247c4feffdd41dcb617dd5c6df76327, user_id=40feb3a750524e5c9f7f4a9e161ac717, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:55.969677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e56fc-ce6d-4adf-aa86-87ee2919ff0f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:55.983391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1154/2356] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:55 2022] PUT /identity/v3/projects/b247c4feffdd41dcb617dd5c6df76327/users/40feb3a750524e5c9f7f4a9e161ac717/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:55.995926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a697f-4dea-4ba6-8245-ca9fec4bcd51 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:55.996404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a697f-4dea-4ba6-8245-ca9fec4bcd51 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:55.996876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a697f-4dea-4ba6-8245-ca9fec4bcd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:56.041636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-195a697f-4dea-4ba6-8245-ca9fec4bcd51 None None] MFA Rules not processed for user `40feb3a750524e5c9f7f4a9e161ac717`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:56.042908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-195a697f-4dea-4ba6-8245-ca9fec4bcd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:56.128230 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1203/2357] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:29:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:56.139760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e56fc-ce6d-4adf-aa86-87ee2919ff0f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:56.141676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-166e56fc-ce6d-4adf-aa86-87ee2919ff0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:56.208026 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e56fc-ce6d-4adf-aa86-87ee2919ff0f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:56.212373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890f1df-a79c-4749-b7bd-a53580088ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:56.213249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890f1df-a79c-4749-b7bd-a53580088ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:56.213526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890f1df-a79c-4749-b7bd-a53580088ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:56.213811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890f1df-a79c-4749-b7bd-a53580088ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:56.224770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890f1df-a79c-4749-b7bd-a53580088ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:56.226282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890f1df-a79c-4749-b7bd-a53580088ff4 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:56.238137 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1155/2358] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:56.934166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a697f-4dea-4ba6-8245-ca9fec4bcd51 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:56.936084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-195a697f-4dea-4ba6-8245-ca9fec4bcd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:56.951066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a697f-4dea-4ba6-8245-ca9fec4bcd51 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:56.956982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76357e59-c3f3-436c-b304-8fb23bc97ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:56.958256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76357e59-c3f3-436c-b304-8fb23bc97ecc service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:56.958722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76357e59-c3f3-436c-b304-8fb23bc97ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:56.959059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76357e59-c3f3-436c-b304-8fb23bc97ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:57.041198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76357e59-c3f3-436c-b304-8fb23bc97ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:57.042726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76357e59-c3f3-436c-b304-8fb23bc97ecc service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:57.053781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1204/2359] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:01.333150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890f1df-a79c-4749-b7bd-a53580088ff4 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:01.342122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890f1df-a79c-4749-b7bd-a53580088ff4 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:01.346121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fda09a-17d8-4eaf-8fa8-d33a55eb0776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:01.346838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fda09a-17d8-4eaf-8fa8-d33a55eb0776 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:01.347115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fda09a-17d8-4eaf-8fa8-d33a55eb0776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:01.347388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fda09a-17d8-4eaf-8fa8-d33a55eb0776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:01.424573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fda09a-17d8-4eaf-8fa8-d33a55eb0776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:01.426024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fda09a-17d8-4eaf-8fa8-d33a55eb0776 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:01.435815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1156/2360] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:30:03.774096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76357e59-c3f3-436c-b304-8fb23bc97ecc service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:03.797582 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:03.859786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76357e59-c3f3-436c-b304-8fb23bc97ecc service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:03.865288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:03.866206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:03.866491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:03.866806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] PATH_INFO: `/v3/users/2622a96ef92b440092e79242fd7105fa` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:03.868171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2622a96ef92b440092e79242fd7105fa)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:03.870184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:03.942400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2622a96ef92b440092e79242fd7105fa'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:03.943127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2622a96ef92b440092e79242fd7105fa'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:03.943807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2622a96ef92b440092e79242fd7105fa'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:03.959098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2622a96ef92b440092e79242fd7105fa'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:03.968273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2622a96ef92b440092e79242fd7105fa'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:03.983434 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1205/2361] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:03 2022] DELETE /identity/v3/users/2622a96ef92b440092e79242fd7105fa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:03.989603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e705-13d3-4de1-8268-c78ea061c6f2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:03.990245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e705-13d3-4de1-8268-c78ea061c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:03.990245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e705-13d3-4de1-8268-c78ea061c6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:04.013122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ec08e705-13d3-4de1-8268-c78ea061c6f2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:04.014361 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ec08e705-13d3-4de1-8268-c78ea061c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:04.089476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1157/2362] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:04.100684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:04.109138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:04.233498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38343c-3113-43ee-8e2c-cb000b75ab5a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:04.239694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4f0ca-55e4-44b5-8f8c-6d56635b4835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:04.241001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f0ca-55e4-44b5-8f8c-6d56635b4835 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:04.241778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f0ca-55e4-44b5-8f8c-6d56635b4835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:04.242254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f0ca-55e4-44b5-8f8c-6d56635b4835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:04.260312 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4f0ca-55e4-44b5-8f8c-6d56635b4835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:04.263334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4f0ca-55e4-44b5-8f8c-6d56635b4835 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:04.283223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1206/2363] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:04.622639 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08e705-13d3-4de1-8268-c78ea061c6f2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:04.624963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ec08e705-13d3-4de1-8268-c78ea061c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:04.647725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08e705-13d3-4de1-8268-c78ea061c6f2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:04.654155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:04.655180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:04.655441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:04.655717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] PATH_INFO: `/v3/projects/e83c6827c69746c0bd8c46d6e0f9c88d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:04.658066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83c6827c69746c0bd8c46d6e0f9c88d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:04.660816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:04.692728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:04.731092 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83c6827c69746c0bd8c46d6e0f9c88d', 'request_id': 'req-1e7fc02c-47d0-45a4-b3c8-270099853fc2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:04.737761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83c6827c69746c0bd8c46d6e0f9c88d', 'request_id': 'req-1e7fc02c-47d0-45a4-b3c8-270099853fc2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:04.747403 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83c6827c69746c0bd8c46d6e0f9c88d', 'request_id': 'req-1e7fc02c-47d0-45a4-b3c8-270099853fc2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:04.760667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] The token cache is being invalidate because project e83c6827c69746c0bd8c46d6e0f9c88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:04.761008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:04.761924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:04.763782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1158/2364] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:04 2022] DELETE /identity/v3/projects/e83c6827c69746c0bd8c46d6e0f9c88d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:04.768158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4f0ca-55e4-44b5-8f8c-6d56635b4835 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:04.784156 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4f0ca-55e4-44b5-8f8c-6d56635b4835 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:04.833278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:04.859941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:04.861123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:04.861305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:04.861580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] PATH_INFO: `/v3/users/2564c77952744d91b0c2116a81997560` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:04.863063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2564c77952744d91b0c2116a81997560)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:04.865140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:04.923335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2564c77952744d91b0c2116a81997560'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:04.924459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2564c77952744d91b0c2116a81997560'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:04.925231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2564c77952744d91b0c2116a81997560'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:04.942251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2564c77952744d91b0c2116a81997560'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:04.952184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2564c77952744d91b0c2116a81997560'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:04.968758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1207/2365] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:04 2022] DELETE /identity/v3/users/2564c77952744d91b0c2116a81997560 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:05.287626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:05.289450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:05.309296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fc02c-47d0-45a4-b3c8-270099853fc2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:05.392357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:05.393234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:05.393510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:05.393781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] PATH_INFO: `/v3/projects/355e8f82ba42414380606ee92b1a3d8c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:05.395066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=355e8f82ba42414380606ee92b1a3d8c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:05.397176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:05.447904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355e8f82ba42414380606ee92b1a3d8c', 'request_id': 'req-775b3c61-2e69-4740-a754-bf53accd1794'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:05.454980 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355e8f82ba42414380606ee92b1a3d8c', 'request_id': 'req-775b3c61-2e69-4740-a754-bf53accd1794'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:05.464387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355e8f82ba42414380606ee92b1a3d8c', 'request_id': 'req-775b3c61-2e69-4740-a754-bf53accd1794'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:05.477811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] The token cache is being invalidate because project 355e8f82ba42414380606ee92b1a3d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:05.478098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:05.478790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:05.480378 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1159/2366] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:05 2022] DELETE /identity/v3/projects/355e8f82ba42414380606ee92b1a3d8c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:05.484730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:05.486418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:05.502038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7615e-a5ad-4b48-b0e3-4fbb44ce3eb4 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:05.566841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:05.567760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:05.568041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:05.568315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] PATH_INFO: `/v3/users/40feb3a750524e5c9f7f4a9e161ac717` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:05.569753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40feb3a750524e5c9f7f4a9e161ac717)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:05.571808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:05.630721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40feb3a750524e5c9f7f4a9e161ac717'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:05.631558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40feb3a750524e5c9f7f4a9e161ac717'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:05.632402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40feb3a750524e5c9f7f4a9e161ac717'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:05.647175 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:05.650890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40feb3a750524e5c9f7f4a9e161ac717'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:05.662776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03520e48-12b9-4ab0-b60c-a382b3da97f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40feb3a750524e5c9f7f4a9e161ac717'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:05.676637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1208/2367] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:05 2022] DELETE /identity/v3/users/40feb3a750524e5c9f7f4a9e161ac717 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:30:05.992680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:05.994287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:06.010534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b3c61-2e69-4740-a754-bf53accd1794 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:06.058990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:06.079428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:06.080384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.080733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.081126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] PATH_INFO: `/v3/projects/b247c4feffdd41dcb617dd5c6df76327` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.082774 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b247c4feffdd41dcb617dd5c6df76327)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:06.085132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:06.137664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b247c4feffdd41dcb617dd5c6df76327', 'request_id': 'req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:06.144562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b247c4feffdd41dcb617dd5c6df76327', 'request_id': 'req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:06.153520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b247c4feffdd41dcb617dd5c6df76327', 'request_id': 'req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:06.166186 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] The token cache is being invalidate because project b247c4feffdd41dcb617dd5c6df76327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:06.166477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:06.167087 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b36c3bb9-a7c7-44f0-9e7d-fb88fc653279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:06.168748 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1160/2368] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:05 2022] DELETE /identity/v3/projects/b247c4feffdd41dcb617dd5c6df76327 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:06.175104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eb1ba-0f49-499e-ba01-4244457b1961 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.175892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eb1ba-0f49-499e-ba01-4244457b1961 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.176056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eb1ba-0f49-499e-ba01-4244457b1961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.195687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-013eb1ba-0f49-499e-ba01-4244457b1961 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:06.196983 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-013eb1ba-0f49-499e-ba01-4244457b1961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:06.268334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1209/2369] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:06.277182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ea46-da77-4580-b30b-530f42f93596 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.277802 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ea46-da77-4580-b30b-530f42f93596 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.278037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ea46-da77-4580-b30b-530f42f93596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.299383 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7e53ea46-da77-4580-b30b-530f42f93596 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:06.300691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7e53ea46-da77-4580-b30b-530f42f93596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:06.309261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1161/2370] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:06.313961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eb1ba-0f49-499e-ba01-4244457b1961 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:06.325550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eb1ba-0f49-499e-ba01-4244457b1961 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:06.330639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929b351-491c-4564-b022-892cf8c34a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:06.331353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929b351-491c-4564-b022-892cf8c34a90 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.331638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929b351-491c-4564-b022-892cf8c34a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.331915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929b351-491c-4564-b022-892cf8c34a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.332660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929b351-491c-4564-b022-892cf8c34a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:30:06.332970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929b351-491c-4564-b022-892cf8c34a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:06.334636 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929b351-491c-4564-b022-892cf8c34a90 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:06.348943 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1210/2371] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:30:06.355892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53ea46-da77-4580-b30b-530f42f93596 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:06.372786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53ea46-da77-4580-b30b-530f42f93596 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:06.380683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24a1c-b1a5-4de9-844b-d93598f86c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:06.381811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24a1c-b1a5-4de9-844b-d93598f86c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.382299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24a1c-b1a5-4de9-844b-d93598f86c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.382824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24a1c-b1a5-4de9-844b-d93598f86c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.384124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f24a1c-b1a5-4de9-844b-d93598f86c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:06.387792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f24a1c-b1a5-4de9-844b-d93598f86c4c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:06.425514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1162/2372] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:06 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:06.430418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929b351-491c-4564-b022-892cf8c34a90 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:06.444248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929b351-491c-4564-b022-892cf8c34a90 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:06.507192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44bf9-4c44-4d03-a5bd-b7a28fd533ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:06.507922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44bf9-4c44-4d03-a5bd-b7a28fd533ca admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.508209 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44bf9-4c44-4d03-a5bd-b7a28fd533ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.508497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44bf9-4c44-4d03-a5bd-b7a28fd533ca admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.509263 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44bf9-4c44-4d03-a5bd-b7a28fd533ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:06.514481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44bf9-4c44-4d03-a5bd-b7a28fd533ca admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:06.537283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1211/2373] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:06 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:30:06.540683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24a1c-b1a5-4de9-844b-d93598f86c4c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:06.551923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24a1c-b1a5-4de9-844b-d93598f86c4c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:06.557719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a097e-6507-42b3-81ec-c0498f6dc771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:06.558398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a097e-6507-42b3-81ec-c0498f6dc771 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.558713 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a097e-6507-42b3-81ec-c0498f6dc771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.558983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a097e-6507-42b3-81ec-c0498f6dc771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.559718 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a097e-6507-42b3-81ec-c0498f6dc771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:06.561340 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a097e-6507-42b3-81ec-c0498f6dc771 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:06.573172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1163/2374] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:30:06.580567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44bf9-4c44-4d03-a5bd-b7a28fd533ca admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:06.598129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44bf9-4c44-4d03-a5bd-b7a28fd533ca admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:06.606842 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf5522-37d1-49d8-9326-d89576045849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:06.608017 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf5522-37d1-49d8-9326-d89576045849 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.608531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf5522-37d1-49d8-9326-d89576045849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.609038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf5522-37d1-49d8-9326-d89576045849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.610675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf5522-37d1-49d8-9326-d89576045849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:06.614491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf5522-37d1-49d8-9326-d89576045849 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:06.636392 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1212/2375] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:06.641671 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a097e-6507-42b3-81ec-c0498f6dc771 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:06.654130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a097e-6507-42b3-81ec-c0498f6dc771 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:06.660350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf1195-63c8-4918-a571-22bb4a1665be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:06.661267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1195-63c8-4918-a571-22bb4a1665be admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.661544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1195-63c8-4918-a571-22bb4a1665be admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.661803 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1195-63c8-4918-a571-22bb4a1665be admin admin] PATH_INFO: `/v3/projects/a74bcbcfa84f4b3fb47e03149e28aa0a/users/bacfc487859448f2b08757c6fbae9744/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.684252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf1195-63c8-4918-a571-22bb4a1665be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74bcbcfa84f4b3fb47e03149e28aa0a, user_id=bacfc487859448f2b08757c6fbae9744, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:06.686936 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf1195-63c8-4918-a571-22bb4a1665be admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:06.701297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1164/2376] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:06 2022] PUT /identity/v3/projects/a74bcbcfa84f4b3fb47e03149e28aa0a/users/bacfc487859448f2b08757c6fbae9744/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:06.713038 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e427cb-aa6f-4510-9339-20b2c39fff90 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.713307 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e427cb-aa6f-4510-9339-20b2c39fff90 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.713600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e427cb-aa6f-4510-9339-20b2c39fff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.743703 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-39e427cb-aa6f-4510-9339-20b2c39fff90 None None] MFA Rules not processed for user `bacfc487859448f2b08757c6fbae9744`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:06.744917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-39e427cb-aa6f-4510-9339-20b2c39fff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:06.781806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:06.820239 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1213/2377] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:06.825115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf1195-63c8-4918-a571-22bb4a1665be admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:06.904677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf1195-63c8-4918-a571-22bb4a1665be admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:06.910460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d58f0-2b83-43cf-8a59-339ebc135aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:06.911301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d58f0-2b83-43cf-8a59-339ebc135aef admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.911712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d58f0-2b83-43cf-8a59-339ebc135aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.911994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d58f0-2b83-43cf-8a59-339ebc135aef admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.912775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d58f0-2b83-43cf-8a59-339ebc135aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:06.914954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d58f0-2b83-43cf-8a59-339ebc135aef admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:06.930746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:06.945937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1165/2378] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:06 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:06.950724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e427cb-aa6f-4510-9339-20b2c39fff90 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:06.962281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e427cb-aa6f-4510-9339-20b2c39fff90 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:07.030416 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15081edb-25ef-4d27-978c-5a46a0db547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:07.031140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15081edb-25ef-4d27-978c-5a46a0db547b admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:07.031427 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15081edb-25ef-4d27-978c-5a46a0db547b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:07.031706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15081edb-25ef-4d27-978c-5a46a0db547b admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:07.032424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15081edb-25ef-4d27-978c-5a46a0db547b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:07.034450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15081edb-25ef-4d27-978c-5a46a0db547b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:07.058211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1214/2379] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:06 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:07.064894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d58f0-2b83-43cf-8a59-339ebc135aef admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:07.083445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d58f0-2b83-43cf-8a59-339ebc135aef admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:07.090490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa7da-eddf-483f-abef-e79e327d7eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:07.091751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa7da-eddf-483f-abef-e79e327d7eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:07.092300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa7da-eddf-483f-abef-e79e327d7eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:07.092754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa7da-eddf-483f-abef-e79e327d7eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:07.094004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaa7da-eddf-483f-abef-e79e327d7eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:07.097844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaa7da-eddf-483f-abef-e79e327d7eaf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:07.114407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1166/2380] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:07.119474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15081edb-25ef-4d27-978c-5a46a0db547b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:07.131408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15081edb-25ef-4d27-978c-5a46a0db547b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:07.137096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c808fb-e954-4abb-b2e0-6f4b43cfe62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:07.138033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c808fb-e954-4abb-b2e0-6f4b43cfe62e admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:07.138305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c808fb-e954-4abb-b2e0-6f4b43cfe62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:07.138616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c808fb-e954-4abb-b2e0-6f4b43cfe62e admin admin] PATH_INFO: `/v3/projects/1dc83c70d92b48de955beb6d92798bf2/users/ff420a9ac06c464997644623f2a60e5d/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:07.160727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c808fb-e954-4abb-b2e0-6f4b43cfe62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc83c70d92b48de955beb6d92798bf2, user_id=ff420a9ac06c464997644623f2a60e5d, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:07.165273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c808fb-e954-4abb-b2e0-6f4b43cfe62e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:07.180000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1215/2381] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:07 2022] PUT /identity/v3/projects/1dc83c70d92b48de955beb6d92798bf2/users/ff420a9ac06c464997644623f2a60e5d/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:30:07.185913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa7da-eddf-483f-abef-e79e327d7eaf admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:07.197273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa7da-eddf-483f-abef-e79e327d7eaf admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:07.262219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ca0ee-a02c-47af-920f-a18b497f8cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:07.262954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ca0ee-a02c-47af-920f-a18b497f8cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:07.263238 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ca0ee-a02c-47af-920f-a18b497f8cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:07.263514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ca0ee-a02c-47af-920f-a18b497f8cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:07.264496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ca0ee-a02c-47af-920f-a18b497f8cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:07.265957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ca0ee-a02c-47af-920f-a18b497f8cb3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:07.278326 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1167/2382] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:07.283172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c808fb-e954-4abb-b2e0-6f4b43cfe62e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:07.298278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c808fb-e954-4abb-b2e0-6f4b43cfe62e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:07.303896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8087-dc0e-4b6a-8952-f52645791a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:07.304858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8087-dc0e-4b6a-8952-f52645791a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:07.305308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8087-dc0e-4b6a-8952-f52645791a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:07.305662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8087-dc0e-4b6a-8952-f52645791a90 admin admin] PATH_INFO: `/v3/projects/1dc83c70d92b48de955beb6d92798bf2/users/ff420a9ac06c464997644623f2a60e5d/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:07.308071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a8087-dc0e-4b6a-8952-f52645791a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc83c70d92b48de955beb6d92798bf2, user_id=ff420a9ac06c464997644623f2a60e5d, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:07.310957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a8087-dc0e-4b6a-8952-f52645791a90 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:07.323717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1216/2383] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:07 2022] PUT /identity/v3/projects/1dc83c70d92b48de955beb6d92798bf2/users/ff420a9ac06c464997644623f2a60e5d/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:07.392905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef348-4448-4ce3-8e26-7ee3c3e6220c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:07.393800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef348-4448-4ce3-8e26-7ee3c3e6220c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:07.393800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef348-4448-4ce3-8e26-7ee3c3e6220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:07.424231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-247ef348-4448-4ce3-8e26-7ee3c3e6220c None None] MFA Rules not processed for user `ff420a9ac06c464997644623f2a60e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:07.425468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-247ef348-4448-4ce3-8e26-7ee3c3e6220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:07.508656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1168/2384] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:07.522040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8087-dc0e-4b6a-8952-f52645791a90 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:07.524080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-515a8087-dc0e-4b6a-8952-f52645791a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:07.596002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8087-dc0e-4b6a-8952-f52645791a90 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:07.601024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad254ec0-d251-46e1-ac4a-630d222651d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:07.601851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad254ec0-d251-46e1-ac4a-630d222651d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:07.602242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad254ec0-d251-46e1-ac4a-630d222651d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:07.602659 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad254ec0-d251-46e1-ac4a-630d222651d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:07.614850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad254ec0-d251-46e1-ac4a-630d222651d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:07.616623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad254ec0-d251-46e1-ac4a-630d222651d4 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:07.634152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1217/2385] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:07.753029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef348-4448-4ce3-8e26-7ee3c3e6220c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:07.765660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef348-4448-4ce3-8e26-7ee3c3e6220c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:07.771034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b698ae-8d7c-4b18-83b1-91680ebd3ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:07.772106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b698ae-8d7c-4b18-83b1-91680ebd3ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:07.772755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b698ae-8d7c-4b18-83b1-91680ebd3ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:07.773279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b698ae-8d7c-4b18-83b1-91680ebd3ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:07.863899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b698ae-8d7c-4b18-83b1-91680ebd3ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:07.865385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b698ae-8d7c-4b18-83b1-91680ebd3ba0 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:07.876200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1169/2386] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:17.627001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:17.871008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:INSERT=1,keystone:SELECT=98 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:20.128977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad254ec0-d251-46e1-ac4a-630d222651d4 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:20.224816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad254ec0-d251-46e1-ac4a-630d222651d4 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:20.232845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:20.234298 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:20.234828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:20.235313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] PATH_INFO: `/v3/users/bacfc487859448f2b08757c6fbae9744` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:20.237752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bacfc487859448f2b08757c6fbae9744)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:20.241747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:20.322277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bacfc487859448f2b08757c6fbae9744'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:20.322990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bacfc487859448f2b08757c6fbae9744'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:20.323642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bacfc487859448f2b08757c6fbae9744'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:20.337569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bacfc487859448f2b08757c6fbae9744'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:20.348775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bacfc487859448f2b08757c6fbae9744'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:20.365278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1218/2387] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:20 2022] DELETE /identity/v3/users/bacfc487859448f2b08757c6fbae9744 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:20.370573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240e62d-1853-4af3-8887-10dad7104b55 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:20.371228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240e62d-1853-4af3-8887-10dad7104b55 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:20.371228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240e62d-1853-4af3-8887-10dad7104b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:20.391007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c240e62d-1853-4af3-8887-10dad7104b55 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:20.392711 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c240e62d-1853-4af3-8887-10dad7104b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:20.493874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1170/2388] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:20.504739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:20.506538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:20.577553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee189-a697-49c5-97d9-9e97ce1c2760 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:20.583993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef374-8eb8-4929-a776-8afa4a481d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:20.585149 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef374-8eb8-4929-a776-8afa4a481d82 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:20.585662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef374-8eb8-4929-a776-8afa4a481d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:20.586176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef374-8eb8-4929-a776-8afa4a481d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:20.603577 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ef374-8eb8-4929-a776-8afa4a481d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:20.606285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ef374-8eb8-4929-a776-8afa4a481d82 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:20.624589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1219/2389] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:21.018121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5526669-c8b4-4007-b945-2b676bbdcc18 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:21.018583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5526669-c8b4-4007-b945-2b676bbdcc18 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:21.019007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5526669-c8b4-4007-b945-2b676bbdcc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:21.056451 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e5526669-c8b4-4007-b945-2b676bbdcc18 None None] MFA Rules not processed for user `a394fc62e6a64a85b855bf2eb56b4b71`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:21.058535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef374-8eb8-4929-a776-8afa4a481d82 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:21.060997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a72ef374-8eb8-4929-a776-8afa4a481d82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:21.063832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e5526669-c8b4-4007-b945-2b676bbdcc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:21.088646 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef374-8eb8-4929-a776-8afa4a481d82 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:21.098355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:21.099851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:21.100316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:21.100798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] PATH_INFO: `/v3/projects/a74bcbcfa84f4b3fb47e03149e28aa0a` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:21.103192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74bcbcfa84f4b3fb47e03149e28aa0a)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:21.106987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:21.134305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:21.147916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1171/2390] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:21.176991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74bcbcfa84f4b3fb47e03149e28aa0a', 'request_id': 'req-b44b0f29-cc5f-4e01-9f52-10765db23ba7'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:21.186713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74bcbcfa84f4b3fb47e03149e28aa0a', 'request_id': 'req-b44b0f29-cc5f-4e01-9f52-10765db23ba7'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:21.194631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74bcbcfa84f4b3fb47e03149e28aa0a', 'request_id': 'req-b44b0f29-cc5f-4e01-9f52-10765db23ba7'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:21.207050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] The token cache is being invalidate because project a74bcbcfa84f4b3fb47e03149e28aa0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:21.207475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:21.208100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:21.209998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1220/2391] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:21 2022] DELETE /identity/v3/projects/a74bcbcfa84f4b3fb47e03149e28aa0a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:21.214661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5526669-c8b4-4007-b945-2b676bbdcc18 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:21.231350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5526669-c8b4-4007-b945-2b676bbdcc18 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:21.312567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:21.313730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:21.314108 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:21.314659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] PATH_INFO: `/v3/users/ff420a9ac06c464997644623f2a60e5d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:21.316190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff420a9ac06c464997644623f2a60e5d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:21.318327 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:21.379943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff420a9ac06c464997644623f2a60e5d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:21.382295 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:21.392218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff420a9ac06c464997644623f2a60e5d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:21.393582 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff420a9ac06c464997644623f2a60e5d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:21.417579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff420a9ac06c464997644623f2a60e5d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:21.432245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-25e6ba98-fecc-4caa-9ab7-958eb2d7e24b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff420a9ac06c464997644623f2a60e5d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:21.444659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1172/2392] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:21 2022] DELETE /identity/v3/users/ff420a9ac06c464997644623f2a60e5d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:22.227141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:22.229182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:22.253603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0f29-cc5f-4e01-9f52-10765db23ba7 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:22.379556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:22.381580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:22.381974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:22.382479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] PATH_INFO: `/v3/projects/1dc83c70d92b48de955beb6d92798bf2` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:22.384903 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc83c70d92b48de955beb6d92798bf2)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:22.388851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:22.472752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc83c70d92b48de955beb6d92798bf2', 'request_id': 'req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:22.484412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc83c70d92b48de955beb6d92798bf2', 'request_id': 'req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:22.494173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc83c70d92b48de955beb6d92798bf2', 'request_id': 'req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:22.513709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] The token cache is being invalidate because project 1dc83c70d92b48de955beb6d92798bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:22.514163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:22.515537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c0e879e7-bfe6-4245-82a0-aaae520fd0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:22.518291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1221/2393] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:22 2022] DELETE /identity/v3/projects/1dc83c70d92b48de955beb6d92798bf2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:22.525450 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffd018-478e-45d4-a457-dddcb295ed84 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:22.526066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffd018-478e-45d4-a457-dddcb295ed84 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:22.526066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffd018-478e-45d4-a457-dddcb295ed84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:22.553685 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-05ffd018-478e-45d4-a457-dddcb295ed84 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:22.554998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-05ffd018-478e-45d4-a457-dddcb295ed84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:22.643182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1173/2394] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:22.656229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de485d-f8aa-4dd0-810b-bcbdadfd62a9 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:22.656706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de485d-f8aa-4dd0-810b-bcbdadfd62a9 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:22.657383 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de485d-f8aa-4dd0-810b-bcbdadfd62a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:22.686759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c8de485d-f8aa-4dd0-810b-bcbdadfd62a9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:22.689551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c8de485d-f8aa-4dd0-810b-bcbdadfd62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:22.700322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1222/2395] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:22.706385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffd018-478e-45d4-a457-dddcb295ed84 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:22.720247 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffd018-478e-45d4-a457-dddcb295ed84 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:22.725410 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840738-cdfe-4db3-931a-724f5222b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:22.726257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840738-cdfe-4db3-931a-724f5222b45b admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:22.726568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840738-cdfe-4db3-931a-724f5222b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:22.726848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840738-cdfe-4db3-931a-724f5222b45b admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:22.727593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6840738-cdfe-4db3-931a-724f5222b45b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:30:22.728051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6840738-cdfe-4db3-931a-724f5222b45b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:22.729691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6840738-cdfe-4db3-931a-724f5222b45b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:22.744833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1174/2396] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:30:22.749632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de485d-f8aa-4dd0-810b-bcbdadfd62a9 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:22.760124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de485d-f8aa-4dd0-810b-bcbdadfd62a9 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:22.765214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec0908-845b-49f9-b05d-741842dbcbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:22.765937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0908-845b-49f9-b05d-741842dbcbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:22.766225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0908-845b-49f9-b05d-741842dbcbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:22.766662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0908-845b-49f9-b05d-741842dbcbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:22.767300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec0908-845b-49f9-b05d-741842dbcbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:22.769284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec0908-845b-49f9-b05d-741842dbcbc1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:22.807307 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1223/2397] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:22 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:22.812275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840738-cdfe-4db3-931a-724f5222b45b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:22.822995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840738-cdfe-4db3-931a-724f5222b45b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:22.899377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d280-769f-40ba-9b94-f1671c6b9475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:22.900511 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d280-769f-40ba-9b94-f1671c6b9475 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:22.901001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d280-769f-40ba-9b94-f1671c6b9475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:22.901498 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d280-769f-40ba-9b94-f1671c6b9475 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:22.903124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581d280-769f-40ba-9b94-f1671c6b9475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:22.907109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581d280-769f-40ba-9b94-f1671c6b9475 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:22.950422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1175/2398] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:22 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:30:22.955668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec0908-845b-49f9-b05d-741842dbcbc1 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:22.967594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec0908-845b-49f9-b05d-741842dbcbc1 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:22.973495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d9662-7aff-429d-ba8b-cb2f3a761fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:22.975112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9662-7aff-429d-ba8b-cb2f3a761fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:22.975411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9662-7aff-429d-ba8b-cb2f3a761fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:22.975717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9662-7aff-429d-ba8b-cb2f3a761fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:22.976516 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d9662-7aff-429d-ba8b-cb2f3a761fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:22.978214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d9662-7aff-429d-ba8b-cb2f3a761fa7 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:22.980015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:22.999026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1224/2399] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:30:23.004382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d280-769f-40ba-9b94-f1671c6b9475 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:23.018189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d280-769f-40ba-9b94-f1671c6b9475 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:23.023787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4014ded-61d5-4c99-862a-59e5267d3cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:23.024481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4014ded-61d5-4c99-862a-59e5267d3cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:23.024758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4014ded-61d5-4c99-862a-59e5267d3cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:23.025038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4014ded-61d5-4c99-862a-59e5267d3cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:23.026028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4014ded-61d5-4c99-862a-59e5267d3cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:23.028534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4014ded-61d5-4c99-862a-59e5267d3cf8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:23.043886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1176/2400] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:23.048788 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d9662-7aff-429d-ba8b-cb2f3a761fa7 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:23.059979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d9662-7aff-429d-ba8b-cb2f3a761fa7 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:23.065390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff8ae7-577d-4ba4-a5e0-66f16e82bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:23.066188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff8ae7-577d-4ba4-a5e0-66f16e82bd61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:23.066470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff8ae7-577d-4ba4-a5e0-66f16e82bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:23.066798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff8ae7-577d-4ba4-a5e0-66f16e82bd61 admin admin] PATH_INFO: `/v3/projects/639b62180e444f759c62c8f97a76a2fb/users/1305600f2f7a4d24b29c58720439b76f/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:23.084615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff8ae7-577d-4ba4-a5e0-66f16e82bd61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639b62180e444f759c62c8f97a76a2fb, user_id=1305600f2f7a4d24b29c58720439b76f, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:23.087413 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff8ae7-577d-4ba4-a5e0-66f16e82bd61 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:23.110561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1225/2401] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:23 2022] PUT /identity/v3/projects/639b62180e444f759c62c8f97a76a2fb/users/1305600f2f7a4d24b29c58720439b76f/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:23.121189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082635b-3260-4077-a485-d34a997e75de None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:23.121475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082635b-3260-4077-a485-d34a997e75de None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:23.121752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082635b-3260-4077-a485-d34a997e75de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:23.156030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b082635b-3260-4077-a485-d34a997e75de None None] MFA Rules not processed for user `1305600f2f7a4d24b29c58720439b76f`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:23.157449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b082635b-3260-4077-a485-d34a997e75de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:23.184087 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:23.243384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1177/2402] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:23.257262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff8ae7-577d-4ba4-a5e0-66f16e82bd61 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:23.259776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-48ff8ae7-577d-4ba4-a5e0-66f16e82bd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:23.344587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff8ae7-577d-4ba4-a5e0-66f16e82bd61 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:23.349627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbbf27-6a26-4b0f-92f2-ce1180986158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:23.350841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbbf27-6a26-4b0f-92f2-ce1180986158 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:23.351359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbbf27-6a26-4b0f-92f2-ce1180986158 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:23.351864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbbf27-6a26-4b0f-92f2-ce1180986158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:23.368540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbbf27-6a26-4b0f-92f2-ce1180986158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:23.371094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbbf27-6a26-4b0f-92f2-ce1180986158 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:23.389133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1226/2403] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:23.416457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082635b-3260-4077-a485-d34a997e75de None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:23.536990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082635b-3260-4077-a485-d34a997e75de None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:23.543938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:23.544866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:23.545146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:23.545417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] PATH_INFO: `/v3/users/1305600f2f7a4d24b29c58720439b76f` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:23.546788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1305600f2f7a4d24b29c58720439b76f)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:23.549080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:23.608225 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1305600f2f7a4d24b29c58720439b76f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:23.619141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1305600f2f7a4d24b29c58720439b76f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:23.620319 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1305600f2f7a4d24b29c58720439b76f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:23.646005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1305600f2f7a4d24b29c58720439b76f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:23.661552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1305600f2f7a4d24b29c58720439b76f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:23.673426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1178/2404] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:23 2022] DELETE /identity/v3/users/1305600f2f7a4d24b29c58720439b76f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:23.680309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baf0f9-59e5-4315-b010-606f81927e24 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:23.680763 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baf0f9-59e5-4315-b010-606f81927e24 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:23.681228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baf0f9-59e5-4315-b010-606f81927e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:23.703032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b1baf0f9-59e5-4315-b010-606f81927e24 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:23.704346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b1baf0f9-59e5-4315-b010-606f81927e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:23.795968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1227/2405] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:30:23.809759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:23.812225 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:23.873646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:23.891448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dd19a-c949-4c7e-aebd-21dc05a9fd26 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:23.895367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bbf05-276e-4bd7-955c-e3f81f691f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:23.896036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbf05-276e-4bd7-955c-e3f81f691f73 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:23.896320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbf05-276e-4bd7-955c-e3f81f691f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:23.896596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbf05-276e-4bd7-955c-e3f81f691f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:23.907359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bbf05-276e-4bd7-955c-e3f81f691f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:23.908709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bbf05-276e-4bd7-955c-e3f81f691f73 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:23.920701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1179/2406] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:24.358225 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baf0f9-59e5-4315-b010-606f81927e24 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:24.360957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b1baf0f9-59e5-4315-b010-606f81927e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:24.385308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baf0f9-59e5-4315-b010-606f81927e24 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:24.394619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:24.396183 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:24.396667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:24.397153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] PATH_INFO: `/v3/projects/639b62180e444f759c62c8f97a76a2fb` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:24.399463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=639b62180e444f759c62c8f97a76a2fb)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:24.403653 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:24.490934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639b62180e444f759c62c8f97a76a2fb', 'request_id': 'req-a365b1e3-8239-45c0-8bc4-5a91841fb947'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:24.503175 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639b62180e444f759c62c8f97a76a2fb', 'request_id': 'req-a365b1e3-8239-45c0-8bc4-5a91841fb947'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:24.514477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639b62180e444f759c62c8f97a76a2fb', 'request_id': 'req-a365b1e3-8239-45c0-8bc4-5a91841fb947'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:24.526468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:24.534133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] The token cache is being invalidate because project 639b62180e444f759c62c8f97a76a2fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:24.534529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:24.535401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a365b1e3-8239-45c0-8bc4-5a91841fb947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:24.537709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1228/2407] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:24 2022] DELETE /identity/v3/projects/639b62180e444f759c62c8f97a76a2fb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:24.544551 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17692123-2044-4940-9448-dee61025ff0e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:24.545161 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17692123-2044-4940-9448-dee61025ff0e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:24.545463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17692123-2044-4940-9448-dee61025ff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:24.566425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-17692123-2044-4940-9448-dee61025ff0e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:24.567736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-17692123-2044-4940-9448-dee61025ff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:24.649577 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1180/2408] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:24.657757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29477825-7630-4294-858d-291543532467 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:24.658131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29477825-7630-4294-858d-291543532467 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:24.658479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29477825-7630-4294-858d-291543532467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:24.679029 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-29477825-7630-4294-858d-291543532467 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:24.680328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-29477825-7630-4294-858d-291543532467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:24.689042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1229/2409] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:30:24.693735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17692123-2044-4940-9448-dee61025ff0e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:24.704226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17692123-2044-4940-9448-dee61025ff0e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:24.709028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25380a0-2e5a-4838-ba81-533604e3f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:24.709707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25380a0-2e5a-4838-ba81-533604e3f28f admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:24.709989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25380a0-2e5a-4838-ba81-533604e3f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:24.710265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25380a0-2e5a-4838-ba81-533604e3f28f admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:24.711054 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25380a0-2e5a-4838-ba81-533604e3f28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:30:24.711373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25380a0-2e5a-4838-ba81-533604e3f28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:24.713119 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25380a0-2e5a-4838-ba81-533604e3f28f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:24.728195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1181/2410] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:30:24.735067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29477825-7630-4294-858d-291543532467 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:24.745501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29477825-7630-4294-858d-291543532467 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:24.751104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51855923-a6b8-4b81-8814-eba7379e29f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:24.751790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51855923-a6b8-4b81-8814-eba7379e29f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:24.752072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51855923-a6b8-4b81-8814-eba7379e29f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:24.752351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51855923-a6b8-4b81-8814-eba7379e29f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:24.753059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51855923-a6b8-4b81-8814-eba7379e29f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:24.755047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51855923-a6b8-4b81-8814-eba7379e29f8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:24.788632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1230/2411] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:24 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:30:24.794007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25380a0-2e5a-4838-ba81-533604e3f28f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:24.806000 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25380a0-2e5a-4838-ba81-533604e3f28f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:24.900094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee2af9-4244-4f22-8288-af00f7f55cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:24.901386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2af9-4244-4f22-8288-af00f7f55cec admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:24.901976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2af9-4244-4f22-8288-af00f7f55cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:24.902921 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2af9-4244-4f22-8288-af00f7f55cec admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:24.904325 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee2af9-4244-4f22-8288-af00f7f55cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:24.908173 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee2af9-4244-4f22-8288-af00f7f55cec admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:24.947649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1182/2412] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:24 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:24.953444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51855923-a6b8-4b81-8814-eba7379e29f8 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:24.967887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51855923-a6b8-4b81-8814-eba7379e29f8 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:24.974540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881dd7a-5391-40b4-b2db-646cf36b21da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:24.975311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881dd7a-5391-40b4-b2db-646cf36b21da admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:24.975640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881dd7a-5391-40b4-b2db-646cf36b21da admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:24.975961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881dd7a-5391-40b4-b2db-646cf36b21da admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:24.976748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881dd7a-5391-40b4-b2db-646cf36b21da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:24.978555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881dd7a-5391-40b4-b2db-646cf36b21da admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:24.996352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1231/2413] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:30:25.000736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee2af9-4244-4f22-8288-af00f7f55cec admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:25.018880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee2af9-4244-4f22-8288-af00f7f55cec admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:25.027541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8e357-2b78-4dca-acc3-48a4061055f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:25.028735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8e357-2b78-4dca-acc3-48a4061055f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:25.029261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8e357-2b78-4dca-acc3-48a4061055f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:25.029716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8e357-2b78-4dca-acc3-48a4061055f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:25.031174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8e357-2b78-4dca-acc3-48a4061055f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:25.034133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8e357-2b78-4dca-acc3-48a4061055f9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:25.050856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1183/2414] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:25.055415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881dd7a-5391-40b4-b2db-646cf36b21da admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:25.066432 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881dd7a-5391-40b4-b2db-646cf36b21da admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:25.072730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01f65-afd3-492b-a95c-3fec2d025c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:25.073630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01f65-afd3-492b-a95c-3fec2d025c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:25.073908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01f65-afd3-492b-a95c-3fec2d025c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:25.074186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01f65-afd3-492b-a95c-3fec2d025c41 admin admin] PATH_INFO: `/v3/projects/76035b914a55410e9137a191824b6de0/users/f69aab4f6930400380027182a78c8e9f/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:25.099132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d01f65-afd3-492b-a95c-3fec2d025c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76035b914a55410e9137a191824b6de0, user_id=f69aab4f6930400380027182a78c8e9f, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:25.104919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d01f65-afd3-492b-a95c-3fec2d025c41 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:25.131193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1232/2415] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:25 2022] PUT /identity/v3/projects/76035b914a55410e9137a191824b6de0/users/f69aab4f6930400380027182a78c8e9f/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:25.148896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c486580-5cd6-4b90-9a49-e9c200d3b875 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:25.149100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c486580-5cd6-4b90-9a49-e9c200d3b875 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:25.149368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c486580-5cd6-4b90-9a49-e9c200d3b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:25.194198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2c486580-5cd6-4b90-9a49-e9c200d3b875 None None] MFA Rules not processed for user `f69aab4f6930400380027182a78c8e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:25.195481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2c486580-5cd6-4b90-9a49-e9c200d3b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:25.283286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:25.322899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1184/2416] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:25.335977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01f65-afd3-492b-a95c-3fec2d025c41 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:25.338862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-90d01f65-afd3-492b-a95c-3fec2d025c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:25.413691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01f65-afd3-492b-a95c-3fec2d025c41 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:25.418120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef41a3-acb8-42e5-9b8a-b2a3dc2241d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:25.418935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef41a3-acb8-42e5-9b8a-b2a3dc2241d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:25.419223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef41a3-acb8-42e5-9b8a-b2a3dc2241d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:25.419505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef41a3-acb8-42e5-9b8a-b2a3dc2241d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:25.429597 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef41a3-acb8-42e5-9b8a-b2a3dc2241d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:25.431135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef41a3-acb8-42e5-9b8a-b2a3dc2241d1 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:25.442556 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1233/2417] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:29.379624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c486580-5cd6-4b90-9a49-e9c200d3b875 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:29.491731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c486580-5cd6-4b90-9a49-e9c200d3b875 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:29.507473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:29.508791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:29.509891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:29.510485 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] PATH_INFO: `/v3/users/f69aab4f6930400380027182a78c8e9f` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:29.514887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69aab4f6930400380027182a78c8e9f)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:29.519411 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:29.645618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69aab4f6930400380027182a78c8e9f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:29.655583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69aab4f6930400380027182a78c8e9f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:29.656292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69aab4f6930400380027182a78c8e9f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:29.671869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69aab4f6930400380027182a78c8e9f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:29.680217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69aab4f6930400380027182a78c8e9f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:29.687469 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1185/2418] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:29 2022] DELETE /identity/v3/users/f69aab4f6930400380027182a78c8e9f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:30:29.692488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc8bb-fb9f-4370-903c-e40bd69da00e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:29.693084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc8bb-fb9f-4370-903c-e40bd69da00e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:29.693084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc8bb-fb9f-4370-903c-e40bd69da00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:29.712186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-048dc8bb-fb9f-4370-903c-e40bd69da00e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:29.713507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-048dc8bb-fb9f-4370-903c-e40bd69da00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:29.786877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1234/2419] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:30:29.798312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:29.800041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:29.870258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b55b34-442f-4ff2-a78d-a5f5047d15c3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:29.874865 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d27c5e-6adf-45f6-af6d-1157259ccbf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:29.875553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d27c5e-6adf-45f6-af6d-1157259ccbf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:29.875958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d27c5e-6adf-45f6-af6d-1157259ccbf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:29.876242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d27c5e-6adf-45f6-af6d-1157259ccbf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:29.887212 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d27c5e-6adf-45f6-af6d-1157259ccbf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:29.888771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d27c5e-6adf-45f6-af6d-1157259ccbf5 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:29.894629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:29.903393 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1186/2420] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:30.226900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc8bb-fb9f-4370-903c-e40bd69da00e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:30.228818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-048dc8bb-fb9f-4370-903c-e40bd69da00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:30.247003 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc8bb-fb9f-4370-903c-e40bd69da00e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:30.260485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:30.261427 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:30.261709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:30.261981 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] PATH_INFO: `/v3/projects/76035b914a55410e9137a191824b6de0` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:30.263359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=76035b914a55410e9137a191824b6de0)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:30.265334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:30.306826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:30.323796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76035b914a55410e9137a191824b6de0', 'request_id': 'req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:30.333336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76035b914a55410e9137a191824b6de0', 'request_id': 'req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:30.340901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76035b914a55410e9137a191824b6de0', 'request_id': 'req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:30.353024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] The token cache is being invalidate because project 76035b914a55410e9137a191824b6de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:30.353321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:30.354045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:30.355801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1235/2421] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:30 2022] DELETE /identity/v3/projects/76035b914a55410e9137a191824b6de0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:32.538359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d27c5e-6adf-45f6-af6d-1157259ccbf5 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:32.540620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-59d27c5e-6adf-45f6-af6d-1157259ccbf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:32.554584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:32.556237 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:32.560220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d27c5e-6adf-45f6-af6d-1157259ccbf5 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:32.624166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2922e-1eb7-45c5-a161-25c8652a5d0c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:32.628518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bb2b8-3a6c-47ce-b659-27849183f60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:32.629184 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bb2b8-3a6c-47ce-b659-27849183f60e service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:32.629465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bb2b8-3a6c-47ce-b659-27849183f60e service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:32.629735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bb2b8-3a6c-47ce-b659-27849183f60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:32.631703 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0f6bb2b8-3a6c-47ce-b659-27849183f60e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:32.647381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e396465-e359-42ca-89f5-8fed25cef27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:32.648126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e396465-e359-42ca-89f5-8fed25cef27b service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:32.648803 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e396465-e359-42ca-89f5-8fed25cef27b service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:32.649189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e396465-e359-42ca-89f5-8fed25cef27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:32.651831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5e396465-e359-42ca-89f5-8fed25cef27b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:32.744989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bb2b8-3a6c-47ce-b659-27849183f60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:32.746761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bb2b8-3a6c-47ce-b659-27849183f60e service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:32.758465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e396465-e359-42ca-89f5-8fed25cef27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:32.760336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e396465-e359-42ca-89f5-8fed25cef27b service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:32.761097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1236/2422] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:30:32.776870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1187/2423] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:39.731476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e166d-491e-4d69-a56d-91e9e7945ffd None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:39.732198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e166d-491e-4d69-a56d-91e9e7945ffd None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:39.732440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e166d-491e-4d69-a56d-91e9e7945ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:39.798120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-791e166d-491e-4d69-a56d-91e9e7945ffd None None] MFA Rules not processed for user `da80b9a52feb462faf0469f2ab701fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:39.799433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-791e166d-491e-4d69-a56d-91e9e7945ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:39.848881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:39.876788 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1237/2424] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:30:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:41.465483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0772f4d-956f-4df9-bb7d-7883fbf9860e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:41.466137 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0772f4d-956f-4df9-bb7d-7883fbf9860e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:41.466984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0772f4d-956f-4df9-bb7d-7883fbf9860e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:41.500406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e0772f4d-956f-4df9-bb7d-7883fbf9860e None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:41.503458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e0772f4d-956f-4df9-bb7d-7883fbf9860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:41.593267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1188/2425] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:30:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:30:41.654245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e166d-491e-4d69-a56d-91e9e7945ffd None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:41.656041 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-791e166d-491e-4d69-a56d-91e9e7945ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:41.755073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e166d-491e-4d69-a56d-91e9e7945ffd None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:41.764123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333364e-9242-4e2f-9875-6ba9c269bd78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:41.765189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333364e-9242-4e2f-9875-6ba9c269bd78 service swift] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:41.765888 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333364e-9242-4e2f-9875-6ba9c269bd78 service swift] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:41.766613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333364e-9242-4e2f-9875-6ba9c269bd78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:41.779177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333364e-9242-4e2f-9875-6ba9c269bd78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:41.781019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333364e-9242-4e2f-9875-6ba9c269bd78 service swift] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:41.792433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1238/2426] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:30:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:30:44.251578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0772f4d-956f-4df9-bb7d-7883fbf9860e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:44.262078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0772f4d-956f-4df9-bb7d-7883fbf9860e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:44.267606 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0267db-327e-4fbe-954d-d21842b826fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:44.268939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0267db-327e-4fbe-954d-d21842b826fc service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:44.270568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0267db-327e-4fbe-954d-d21842b826fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:44.270568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0267db-327e-4fbe-954d-d21842b826fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:44.271939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9b0267db-327e-4fbe-954d-d21842b826fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:44.353404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:44.415158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0267db-327e-4fbe-954d-d21842b826fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:44.427960 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0267db-327e-4fbe-954d-d21842b826fc service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:44.465801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1189/2427] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:46.649935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333364e-9242-4e2f-9875-6ba9c269bd78 service swift] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:46.652716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1333364e-9242-4e2f-9875-6ba9c269bd78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:46.693897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333364e-9242-4e2f-9875-6ba9c269bd78 service swift] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:46.703159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11ebca-cb6d-42f2-a6d1-29471b204326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:46.704839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11ebca-cb6d-42f2-a6d1-29471b204326 service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:46.705603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11ebca-cb6d-42f2-a6d1-29471b204326 service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:46.706405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11ebca-cb6d-42f2-a6d1-29471b204326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:46.710481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2c11ebca-cb6d-42f2-a6d1-29471b204326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:46.912251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11ebca-cb6d-42f2-a6d1-29471b204326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:46.915714 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11ebca-cb6d-42f2-a6d1-29471b204326 service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:46.948919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1239/2428] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:52.212247 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0267db-327e-4fbe-954d-d21842b826fc service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:52.237176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0267db-327e-4fbe-954d-d21842b826fc service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:52.249244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea0852-da62-427a-9a1d-e1a43b33c177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:52.250578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea0852-da62-427a-9a1d-e1a43b33c177 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:52.252555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea0852-da62-427a-9a1d-e1a43b33c177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:52.253042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea0852-da62-427a-9a1d-e1a43b33c177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:52.256693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-01ea0852-da62-427a-9a1d-e1a43b33c177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:52.283997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea0852-da62-427a-9a1d-e1a43b33c177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:52.287059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea0852-da62-427a-9a1d-e1a43b33c177 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:52.358900 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1190/2429] 10.222.0.66 () {60 vars in 1396 bytes} [Wed Jun 22 10:30:52 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:56.943760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=79 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:00.653963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11ebca-cb6d-42f2-a6d1-29471b204326 service nova] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:00.655971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2c11ebca-cb6d-42f2-a6d1-29471b204326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:00.671732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11ebca-cb6d-42f2-a6d1-29471b204326 service nova] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:00.678277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db13a59-0af5-450a-8140-81fded41f549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:00.679714 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db13a59-0af5-450a-8140-81fded41f549 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:00.680242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db13a59-0af5-450a-8140-81fded41f549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:00.680723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db13a59-0af5-450a-8140-81fded41f549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:00.683464 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-7db13a59-0af5-450a-8140-81fded41f549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:00.697260 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db13a59-0af5-450a-8140-81fded41f549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:00.699722 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db13a59-0af5-450a-8140-81fded41f549 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:00.713988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1240/2430] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:02.339412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=19 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:02.717508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d1cc0-a465-4353-b140-90d326802e3a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:02.718530 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d1cc0-a465-4353-b140-90d326802e3a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:02.720548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d1cc0-a465-4353-b140-90d326802e3a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:02.723222 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1191/2431] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:31:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:31:02.757898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578bf46-cab7-4c28-855a-17ea7f84cb32 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:02.759535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578bf46-cab7-4c28-855a-17ea7f84cb32 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:02.760227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578bf46-cab7-4c28-855a-17ea7f84cb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:02.813076 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-2578bf46-cab7-4c28-855a-17ea7f84cb32 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:31:02.817831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2578bf46-cab7-4c28-855a-17ea7f84cb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:02.847604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1241/2432] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:31:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:31:02.873240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d1cc0-a465-4353-b140-90d326802e3a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:02.876342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-125d1cc0-a465-4353-b140-90d326802e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:03.065392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d1cc0-a465-4353-b140-90d326802e3a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:03.072179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8233ff-737c-40d9-a0e6-4364d23fbfac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0055a33a380435d83a6d7384417c10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:03.073278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8233ff-737c-40d9-a0e6-4364d23fbfac service glance] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:03.073828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8233ff-737c-40d9-a0e6-4364d23fbfac service glance] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:03.074355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8233ff-737c-40d9-a0e6-4364d23fbfac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:03.091090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8233ff-737c-40d9-a0e6-4364d23fbfac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:03.092860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8233ff-737c-40d9-a0e6-4364d23fbfac service glance] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:03.114253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1192/2433] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:03.216498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e72a-cc91-42af-bc11-daf7ce4365fa None None] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:03.216926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e72a-cc91-42af-bc11-daf7ce4365fa None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:03.217296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e72a-cc91-42af-bc11-daf7ce4365fa None None] PATH_INFO: `/` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:03.219199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1242/2434] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:31:03.225179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381741a-c562-476f-b8bd-23c80b877d72 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:03.225607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381741a-c562-476f-b8bd-23c80b877d72 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:03.225969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381741a-c562-476f-b8bd-23c80b877d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:03.274756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7381741a-c562-476f-b8bd-23c80b877d72 None None] MFA Rules not processed for user `0afeafd76edb40289d715f81485fa7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:31:03.276022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7381741a-c562-476f-b8bd-23c80b877d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:03.284028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1193/2435] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:31:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:31:03.297009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48e72a-cc91-42af-bc11-daf7ce4365fa None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:03.309389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48e72a-cc91-42af-bc11-daf7ce4365fa None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:03.313388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a8ac5-3de7-4253-99d3-f1c85494558d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:03.314052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a8ac5-3de7-4253-99d3-f1c85494558d service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:03.314333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a8ac5-3de7-4253-99d3-f1c85494558d service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:03.314679 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a8ac5-3de7-4253-99d3-f1c85494558d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:03.323205 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a8ac5-3de7-4253-99d3-f1c85494558d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:03.324674 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a8ac5-3de7-4253-99d3-f1c85494558d service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:03.334182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1243/2436] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:03.428442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ea8b-b4b9-4656-8b0b-1661f32b8556 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:03.429275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ea8b-b4b9-4656-8b0b-1661f32b8556 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:03.429472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ea8b-b4b9-4656-8b0b-1661f32b8556 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:03.433660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1194/2437] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 10:31:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:31:03.440966 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edc4ea-c213-4bc8-badb-48c4e8fc4e13 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:03.441599 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edc4ea-c213-4bc8-badb-48c4e8fc4e13 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:03.442081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edc4ea-c213-4bc8-badb-48c4e8fc4e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:03.464605 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-17edc4ea-c213-4bc8-badb-48c4e8fc4e13 None None] MFA Rules not processed for user `f91c2e9ae8844d9181aff785c02cf3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:31:03.465874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-17edc4ea-c213-4bc8-badb-48c4e8fc4e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:03.477216 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1244/2438] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 10:31:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:31:03.491975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6ea8b-b4b9-4656-8b0b-1661f32b8556 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:03.505220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6ea8b-b4b9-4656-8b0b-1661f32b8556 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:03.509608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6851c1-aec3-4e3b-a03c-ad9b58508ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:03.510269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6851c1-aec3-4e3b-a03c-ad9b58508ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:03.510745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6851c1-aec3-4e3b-a03c-ad9b58508ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:03.511019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6851c1-aec3-4e3b-a03c-ad9b58508ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:03.523537 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6851c1-aec3-4e3b-a03c-ad9b58508ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:03.525008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6851c1-aec3-4e3b-a03c-ad9b58508ad0 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:03.538342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1195/2439] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:03.606367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edc4ea-c213-4bc8-badb-48c4e8fc4e13 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:03.608050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-17edc4ea-c213-4bc8-badb-48c4e8fc4e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:03.688985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edc4ea-c213-4bc8-badb-48c4e8fc4e13 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:03.695189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48f56-7948-4e37-89fc-8c3c004ea11b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:03.695839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48f56-7948-4e37-89fc-8c3c004ea11b service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:03.696126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48f56-7948-4e37-89fc-8c3c004ea11b service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:03.696407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48f56-7948-4e37-89fc-8c3c004ea11b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:03.698452 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-50c48f56-7948-4e37-89fc-8c3c004ea11b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:03.711572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48f56-7948-4e37-89fc-8c3c004ea11b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:03.713272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48f56-7948-4e37-89fc-8c3c004ea11b service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:03.724826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1245/2440] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:06.012800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5316afc-cdd8-41c9-8d95-a8dc6aa6392d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:06.013660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5316afc-cdd8-41c9-8d95-a8dc6aa6392d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:06.013660 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5316afc-cdd8-41c9-8d95-a8dc6aa6392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:06.035931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b5316afc-cdd8-41c9-8d95-a8dc6aa6392d None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:31:06.037204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b5316afc-cdd8-41c9-8d95-a8dc6aa6392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:06.045752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1196/2441] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:31:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:31:06.058317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48f56-7948-4e37-89fc-8c3c004ea11b service placement] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:06.070810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48f56-7948-4e37-89fc-8c3c004ea11b service placement] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:06.076531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7223-267f-454d-82c6-3637e07104ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:06.077231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7223-267f-454d-82c6-3637e07104ad service swift] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:06.077515 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7223-267f-454d-82c6-3637e07104ad service swift] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:06.077790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7223-267f-454d-82c6-3637e07104ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:06.088415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b7223-267f-454d-82c6-3637e07104ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:06.090186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b7223-267f-454d-82c6-3637e07104ad service swift] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:06.103236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1246/2442] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:31:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:31:16.029757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=44 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:16.096442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=56 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:34.987519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5316afc-cdd8-41c9-8d95-a8dc6aa6392d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:34.990267 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b5316afc-cdd8-41c9-8d95-a8dc6aa6392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:35.018358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5316afc-cdd8-41c9-8d95-a8dc6aa6392d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:35.028407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef239b94-626e-42f2-954d-94ce9364c34c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:35.029500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef239b94-626e-42f2-954d-94ce9364c34c service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:35.029996 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef239b94-626e-42f2-954d-94ce9364c34c service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:35.030484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef239b94-626e-42f2-954d-94ce9364c34c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:35.034009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ef239b94-626e-42f2-954d-94ce9364c34c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:35.057364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef239b94-626e-42f2-954d-94ce9364c34c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:35.060501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef239b94-626e-42f2-954d-94ce9364c34c service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:35.077987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1197/2443] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:36.971318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a540d4c-2dd1-413d-9686-d2560e7d6c6e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:36.972224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a540d4c-2dd1-413d-9686-d2560e7d6c6e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:36.972224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a540d4c-2dd1-413d-9686-d2560e7d6c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:36.994678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0a540d4c-2dd1-413d-9686-d2560e7d6c6e None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:31:36.996414 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0a540d4c-2dd1-413d-9686-d2560e7d6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:37.006300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1247/2444] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 10:31:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:31:37.019328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef239b94-626e-42f2-954d-94ce9364c34c service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:37.032377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef239b94-626e-42f2-954d-94ce9364c34c service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:37.038657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d4357-1b03-4b65-a43f-4cb88e79df0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:37.039369 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4357-1b03-4b65-a43f-4cb88e79df0e service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:37.039599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4357-1b03-4b65-a43f-4cb88e79df0e service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:37.040013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4357-1b03-4b65-a43f-4cb88e79df0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:37.049763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d4357-1b03-4b65-a43f-4cb88e79df0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:37.051435 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d4357-1b03-4b65-a43f-4cb88e79df0e service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:37.061521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1198/2445] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:31:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:31:46.987550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:47.057172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=12 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:55.010590 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a540d4c-2dd1-413d-9686-d2560e7d6c6e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:55.021655 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a540d4c-2dd1-413d-9686-d2560e7d6c6e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:55.025655 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08da64-6136-4dff-acff-f69e002f0fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:55.026341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08da64-6136-4dff-acff-f69e002f0fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:55.026670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08da64-6136-4dff-acff-f69e002f0fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:55.026954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08da64-6136-4dff-acff-f69e002f0fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:55.029402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ec08da64-6136-4dff-acff-f69e002f0fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:55.110758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08da64-6136-4dff-acff-f69e002f0fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:55.112258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08da64-6136-4dff-acff-f69e002f0fc4 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:55.123845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1248/2446] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:58.928417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d4357-1b03-4b65-a43f-4cb88e79df0e service swift] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:58.948075 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d4357-1b03-4b65-a43f-4cb88e79df0e service swift] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:58.955708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179da81e-8e7e-43dc-8547-8c06e9b42c10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:58.956725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179da81e-8e7e-43dc-8547-8c06e9b42c10 service placement] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:58.957207 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179da81e-8e7e-43dc-8547-8c06e9b42c10 service placement] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:58.957635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179da81e-8e7e-43dc-8547-8c06e9b42c10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:58.960165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-179da81e-8e7e-43dc-8547-8c06e9b42c10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:58.980774 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179da81e-8e7e-43dc-8547-8c06e9b42c10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:58.984551 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179da81e-8e7e-43dc-8547-8c06e9b42c10 service placement] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:58.991385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08da64-6136-4dff-acff-f69e002f0fc4 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:58.993596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ec08da64-6136-4dff-acff-f69e002f0fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:59.005953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1199/2447] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:59.017619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08da64-6136-4dff-acff-f69e002f0fc4 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:59.027078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:59.029886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:59.030835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:59.031633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] PATH_INFO: `/v3/users/595531abf958489795f2363026697a5b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:59.059650 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] RBAC: Authorizing `identity:delete_user(user_id=595531abf958489795f2363026697a5b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:59.062267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:59.124921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595531abf958489795f2363026697a5b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:59.125688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595531abf958489795f2363026697a5b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:59.126382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595531abf958489795f2363026697a5b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:59.141869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595531abf958489795f2363026697a5b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:59.152985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-faac59c5-ed0c-43d4-948a-77076e5c449f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595531abf958489795f2363026697a5b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:59.169386 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1249/2448] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:31:58 2022] DELETE /identity/v3/users/595531abf958489795f2363026697a5b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:31:59.457045 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179da81e-8e7e-43dc-8547-8c06e9b42c10 service placement] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:59.483017 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179da81e-8e7e-43dc-8547-8c06e9b42c10 service placement] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:59.567932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:59.569052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:59.569629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:59.570313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] PATH_INFO: `/v3/projects/fecb66f4a7094cd3963caf460c52b88b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:59.586628 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fecb66f4a7094cd3963caf460c52b88b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:59.588743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:59.651042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fecb66f4a7094cd3963caf460c52b88b', 'request_id': 'req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:59.658818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fecb66f4a7094cd3963caf460c52b88b', 'request_id': 'req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:59.669059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fecb66f4a7094cd3963caf460c52b88b', 'request_id': 'req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:59.684027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] The token cache is being invalidate because project fecb66f4a7094cd3963caf460c52b88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:31:59.684465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:59.685284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a1f6bced-1169-4f5b-8bc4-48e6b5df218f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:59.687146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1200/2449] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:31:59 2022] DELETE /identity/v3/projects/fecb66f4a7094cd3963caf460c52b88b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:31:59.694372 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73296533-10cd-41f3-a698-fc710c88e206 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:59.694819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73296533-10cd-41f3-a698-fc710c88e206 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:59.695185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73296533-10cd-41f3-a698-fc710c88e206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:59.717285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-73296533-10cd-41f3-a698-fc710c88e206 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:31:59.718718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-73296533-10cd-41f3-a698-fc710c88e206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:59.775758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:59.791786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1250/2450] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:31:59.800415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a310-f8e9-4604-8f8d-15de73dfc447 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:59.800894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a310-f8e9-4604-8f8d-15de73dfc447 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:59.801227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a310-f8e9-4604-8f8d-15de73dfc447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:59.822029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d533a310-f8e9-4604-8f8d-15de73dfc447 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:31:59.823330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d533a310-f8e9-4604-8f8d-15de73dfc447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:59.832798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1201/2451] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:31:59.837672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73296533-10cd-41f3-a698-fc710c88e206 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:59.851286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73296533-10cd-41f3-a698-fc710c88e206 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:59.858189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174d073-a720-4034-aea2-525520077c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:59.859534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d073-a720-4034-aea2-525520077c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:59.860059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d073-a720-4034-aea2-525520077c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:59.860551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d073-a720-4034-aea2-525520077c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:59.861964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174d073-a720-4034-aea2-525520077c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:31:59.863961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174d073-a720-4034-aea2-525520077c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:59.866932 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174d073-a720-4034-aea2-525520077c4f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:59.883355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1251/2452] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:31:59.888977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533a310-f8e9-4604-8f8d-15de73dfc447 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:59.906357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533a310-f8e9-4604-8f8d-15de73dfc447 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:59.915514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27306-8cbd-4b9b-9084-03adcfa04208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:59.916277 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27306-8cbd-4b9b-9084-03adcfa04208 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:59.916600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27306-8cbd-4b9b-9084-03adcfa04208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:59.916940 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27306-8cbd-4b9b-9084-03adcfa04208 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:59.917680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f27306-8cbd-4b9b-9084-03adcfa04208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:59.919827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f27306-8cbd-4b9b-9084-03adcfa04208 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:59.953000 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1202/2453] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:31:59 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:31:59.957572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174d073-a720-4034-aea2-525520077c4f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:59.969686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174d073-a720-4034-aea2-525520077c4f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:00.043236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba7bd5-5f01-4889-ba3b-7aa4591e1e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:00.044066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba7bd5-5f01-4889-ba3b-7aa4591e1e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.044470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba7bd5-5f01-4889-ba3b-7aa4591e1e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.044787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba7bd5-5f01-4889-ba3b-7aa4591e1e91 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.045616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba7bd5-5f01-4889-ba3b-7aa4591e1e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:00.047841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba7bd5-5f01-4889-ba3b-7aa4591e1e91 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:00.075768 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1252/2454] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:31:59 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:00.080228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27306-8cbd-4b9b-9084-03adcfa04208 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:00.092021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27306-8cbd-4b9b-9084-03adcfa04208 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:00.099473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d0ee5-626e-4af8-93c0-2e2ab740a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:00.100640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0ee5-626e-4af8-93c0-2e2ab740a495 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.101132 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0ee5-626e-4af8-93c0-2e2ab740a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.101620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0ee5-626e-4af8-93c0-2e2ab740a495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.103089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d0ee5-626e-4af8-93c0-2e2ab740a495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:00.106143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d0ee5-626e-4af8-93c0-2e2ab740a495 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:00.125878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1203/2455] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:00.131341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba7bd5-5f01-4889-ba3b-7aa4591e1e91 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:00.142299 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba7bd5-5f01-4889-ba3b-7aa4591e1e91 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:00.149835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d078e9-46a4-4deb-a00b-d590f5b175fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:00.151064 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d078e9-46a4-4deb-a00b-d590f5b175fa admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.151570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d078e9-46a4-4deb-a00b-d590f5b175fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.152067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d078e9-46a4-4deb-a00b-d590f5b175fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.153854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d078e9-46a4-4deb-a00b-d590f5b175fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:00.156858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d078e9-46a4-4deb-a00b-d590f5b175fa admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:00.176616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1253/2456] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:00.181760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d0ee5-626e-4af8-93c0-2e2ab740a495 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:00.199683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d0ee5-626e-4af8-93c0-2e2ab740a495 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:00.208396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a627245-5841-4bd5-a6ef-2479b5f27f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:00.209919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627245-5841-4bd5-a6ef-2479b5f27f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.210458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627245-5841-4bd5-a6ef-2479b5f27f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.210995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627245-5841-4bd5-a6ef-2479b5f27f61 admin admin] PATH_INFO: `/v3/projects/d56b811e3d404034b9079f57ba542da1/users/d3c28eb61b4444f7a21f87beff17de37/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.239805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a627245-5841-4bd5-a6ef-2479b5f27f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56b811e3d404034b9079f57ba542da1, user_id=d3c28eb61b4444f7a21f87beff17de37, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:00.245201 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a627245-5841-4bd5-a6ef-2479b5f27f61 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:00.264746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1204/2457] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:00 2022] PUT /identity/v3/projects/d56b811e3d404034b9079f57ba542da1/users/d3c28eb61b4444f7a21f87beff17de37/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:00.277380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9cff1-d83f-445b-9107-02ab86280c34 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.278072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9cff1-d83f-445b-9107-02ab86280c34 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.278294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9cff1-d83f-445b-9107-02ab86280c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.312534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8ac9cff1-d83f-445b-9107-02ab86280c34 None None] MFA Rules not processed for user `d3c28eb61b4444f7a21f87beff17de37`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:00.313813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8ac9cff1-d83f-445b-9107-02ab86280c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:00.423711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1254/2458] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:00.431001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a627245-5841-4bd5-a6ef-2479b5f27f61 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:00.440771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:00.510140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a627245-5841-4bd5-a6ef-2479b5f27f61 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:00.515702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa916d9-7657-4d86-968c-2a6184625ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:00.516419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa916d9-7657-4d86-968c-2a6184625ffe admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.516701 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa916d9-7657-4d86-968c-2a6184625ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.516969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa916d9-7657-4d86-968c-2a6184625ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.517682 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa916d9-7657-4d86-968c-2a6184625ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:00.519740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa916d9-7657-4d86-968c-2a6184625ffe admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:00.551129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1205/2459] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:00 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:00.556074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9cff1-d83f-445b-9107-02ab86280c34 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:00.569462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9cff1-d83f-445b-9107-02ab86280c34 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:00.632890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:00.651773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e11fb-5633-457f-a376-b71f171f39c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:00.652968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e11fb-5633-457f-a376-b71f171f39c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.653344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e11fb-5633-457f-a376-b71f171f39c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.653781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e11fb-5633-457f-a376-b71f171f39c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.654677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e11fb-5633-457f-a376-b71f171f39c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:00.658775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e11fb-5633-457f-a376-b71f171f39c8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:00.684009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1255/2460] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:00 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:00.689510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa916d9-7657-4d86-968c-2a6184625ffe admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:00.701781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa916d9-7657-4d86-968c-2a6184625ffe admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:00.707961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4f1f6-49f6-407d-91ee-afdc15d28d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:00.708768 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4f1f6-49f6-407d-91ee-afdc15d28d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.709192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4f1f6-49f6-407d-91ee-afdc15d28d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.709527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4f1f6-49f6-407d-91ee-afdc15d28d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.710352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4f1f6-49f6-407d-91ee-afdc15d28d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:00.712616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4f1f6-49f6-407d-91ee-afdc15d28d8b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:00.726480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1206/2461] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:32:00.731380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e11fb-5633-457f-a376-b71f171f39c8 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:00.742880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e11fb-5633-457f-a376-b71f171f39c8 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:00.748566 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f3861-233c-4cce-ba7e-5f6bfb94079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:00.749912 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f3861-233c-4cce-ba7e-5f6bfb94079a admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.750268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f3861-233c-4cce-ba7e-5f6bfb94079a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.750638 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f3861-233c-4cce-ba7e-5f6bfb94079a admin admin] PATH_INFO: `/v3/projects/9624167516d14fbfbeef4c8db8758ef3/users/2372936c59ff432fb191fe7890248510/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.768802 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f3861-233c-4cce-ba7e-5f6bfb94079a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9624167516d14fbfbeef4c8db8758ef3, user_id=2372936c59ff432fb191fe7890248510, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:00.772264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f3861-233c-4cce-ba7e-5f6bfb94079a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:00.788946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1256/2462] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:00 2022] PUT /identity/v3/projects/9624167516d14fbfbeef4c8db8758ef3/users/2372936c59ff432fb191fe7890248510/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:00.793791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4f1f6-49f6-407d-91ee-afdc15d28d8b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:00.805620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4f1f6-49f6-407d-91ee-afdc15d28d8b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:00.884768 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5745f-fe1f-4779-879f-5e7ae9523ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:00.885567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5745f-fe1f-4779-879f-5e7ae9523ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.885904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5745f-fe1f-4779-879f-5e7ae9523ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.886220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5745f-fe1f-4779-879f-5e7ae9523ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.887074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5745f-fe1f-4779-879f-5e7ae9523ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:00.889309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5745f-fe1f-4779-879f-5e7ae9523ed2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:00.901429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1207/2463] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:00.906619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f3861-233c-4cce-ba7e-5f6bfb94079a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:00.918707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f3861-233c-4cce-ba7e-5f6bfb94079a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:00.924383 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae370ff-ed2e-44f8-92e9-07f68b5b02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:00.925365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae370ff-ed2e-44f8-92e9-07f68b5b02b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.925696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae370ff-ed2e-44f8-92e9-07f68b5b02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.926040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae370ff-ed2e-44f8-92e9-07f68b5b02b9 admin admin] PATH_INFO: `/v3/projects/9624167516d14fbfbeef4c8db8758ef3/users/2372936c59ff432fb191fe7890248510/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.928381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae370ff-ed2e-44f8-92e9-07f68b5b02b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9624167516d14fbfbeef4c8db8758ef3, user_id=2372936c59ff432fb191fe7890248510, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:00.931388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae370ff-ed2e-44f8-92e9-07f68b5b02b9 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:00.944490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1257/2464] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:00 2022] PUT /identity/v3/projects/9624167516d14fbfbeef4c8db8758ef3/users/2372936c59ff432fb191fe7890248510/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:32:00.956083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853cc7-d96a-4b6d-bc1b-06fc208bea46 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:00.956706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853cc7-d96a-4b6d-bc1b-06fc208bea46 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:00.956706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853cc7-d96a-4b6d-bc1b-06fc208bea46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:00.996714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7a853cc7-d96a-4b6d-bc1b-06fc208bea46 None None] MFA Rules not processed for user `2372936c59ff432fb191fe7890248510`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:00.998924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7a853cc7-d96a-4b6d-bc1b-06fc208bea46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:01.085073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:01.094872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1208/2465] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:01.103972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae370ff-ed2e-44f8-92e9-07f68b5b02b9 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:01.106008 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-eae370ff-ed2e-44f8-92e9-07f68b5b02b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:01.178764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae370ff-ed2e-44f8-92e9-07f68b5b02b9 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:01.183323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37eb541-393a-4340-8980-1e55c9b0106f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:01.184049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37eb541-393a-4340-8980-1e55c9b0106f service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:01.184387 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37eb541-393a-4340-8980-1e55c9b0106f service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:01.184707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37eb541-393a-4340-8980-1e55c9b0106f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:01.197226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37eb541-393a-4340-8980-1e55c9b0106f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:01.199176 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37eb541-393a-4340-8980-1e55c9b0106f service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:01.213249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1258/2466] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:01.669407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a853cc7-d96a-4b6d-bc1b-06fc208bea46 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:01.747338 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a853cc7-d96a-4b6d-bc1b-06fc208bea46 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:01.753907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:01.754875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:01.755160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:01.755437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] PATH_INFO: `/v3/users/d3c28eb61b4444f7a21f87beff17de37` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:01.756912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c28eb61b4444f7a21f87beff17de37)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:01.758986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:01.827543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c28eb61b4444f7a21f87beff17de37'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:01.838106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c28eb61b4444f7a21f87beff17de37'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:01.839117 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c28eb61b4444f7a21f87beff17de37'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:01.855683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c28eb61b4444f7a21f87beff17de37'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:01.864361 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c28eb61b4444f7a21f87beff17de37'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:01.871373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1209/2467] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:01 2022] DELETE /identity/v3/users/d3c28eb61b4444f7a21f87beff17de37 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:01.877490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68db90-0fac-4fa7-be53-89c2270be326 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:01.878008 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68db90-0fac-4fa7-be53-89c2270be326 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:01.878532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68db90-0fac-4fa7-be53-89c2270be326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:01.912177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-dd68db90-0fac-4fa7-be53-89c2270be326 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:01.914289 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-dd68db90-0fac-4fa7-be53-89c2270be326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:02.020934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1259/2468] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:02.035294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:02.037421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:02.105390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e209b3-7965-4cbc-83ea-4ec02f814902 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:02.109892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb26d12-87d5-46b9-adf3-8e208a479360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:02.110666 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb26d12-87d5-46b9-adf3-8e208a479360 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:02.111038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb26d12-87d5-46b9-adf3-8e208a479360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:02.111417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb26d12-87d5-46b9-adf3-8e208a479360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:02.123391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb26d12-87d5-46b9-adf3-8e208a479360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:02.125209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb26d12-87d5-46b9-adf3-8e208a479360 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:02.137032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1210/2469] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:02.473043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68db90-0fac-4fa7-be53-89c2270be326 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:02.475559 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-dd68db90-0fac-4fa7-be53-89c2270be326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:02.493247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68db90-0fac-4fa7-be53-89c2270be326 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:02.499807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:02.500801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:02.501144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:02.501564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] PATH_INFO: `/v3/projects/d56b811e3d404034b9079f57ba542da1` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:02.503446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56b811e3d404034b9079f57ba542da1)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:02.506999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:02.561956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:02.577809 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56b811e3d404034b9079f57ba542da1', 'request_id': 'req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:02.588047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56b811e3d404034b9079f57ba542da1', 'request_id': 'req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:02.601549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56b811e3d404034b9079f57ba542da1', 'request_id': 'req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:02.621055 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] The token cache is being invalidate because project d56b811e3d404034b9079f57ba542da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:02.621361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:02.622043 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:02.623852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1260/2470] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:02 2022] DELETE /identity/v3/projects/d56b811e3d404034b9079f57ba542da1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:02.628322 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb26d12-87d5-46b9-adf3-8e208a479360 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:02.641516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb26d12-87d5-46b9-adf3-8e208a479360 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:02.665710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:02.715706 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:02.716920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:02.717321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:02.717646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] PATH_INFO: `/v3/users/2372936c59ff432fb191fe7890248510` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:02.719362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2372936c59ff432fb191fe7890248510)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:02.721483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:02.781885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2372936c59ff432fb191fe7890248510'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:02.795159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2372936c59ff432fb191fe7890248510'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:02.796162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2372936c59ff432fb191fe7890248510'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:02.819242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2372936c59ff432fb191fe7890248510'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:02.832664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5ccd8a51-9151-4299-a7ba-a56e473e7e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2372936c59ff432fb191fe7890248510'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:02.843714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1211/2471] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:02 2022] DELETE /identity/v3/users/2372936c59ff432fb191fe7890248510 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:03.202733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:03.204539 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:03.223304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ec047-d35b-4292-bd0b-9d7bd85941a5 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:03.295435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:03.296375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:03.296657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:03.296930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] PATH_INFO: `/v3/projects/9624167516d14fbfbeef4c8db8758ef3` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:03.298446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9624167516d14fbfbeef4c8db8758ef3)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:03.300794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:03.359874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9624167516d14fbfbeef4c8db8758ef3', 'request_id': 'req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:03.369733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9624167516d14fbfbeef4c8db8758ef3', 'request_id': 'req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:03.378320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9624167516d14fbfbeef4c8db8758ef3', 'request_id': 'req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:03.393686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] The token cache is being invalidate because project 9624167516d14fbfbeef4c8db8758ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:03.393975 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:03.394778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cad2a7b9-56ca-4cb2-bde5-4b1021ce7efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:03.396519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1261/2472] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:03 2022] DELETE /identity/v3/projects/9624167516d14fbfbeef4c8db8758ef3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:32:03.402862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175eee80-444a-4159-a894-8dc05875a56b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:03.403521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175eee80-444a-4159-a894-8dc05875a56b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:03.403638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175eee80-444a-4159-a894-8dc05875a56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:03.426479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-175eee80-444a-4159-a894-8dc05875a56b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:03.427775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-175eee80-444a-4159-a894-8dc05875a56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:03.503795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1212/2473] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:03.513451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887c40-83c9-4901-9243-b1b3eaafd685 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:03.514144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887c40-83c9-4901-9243-b1b3eaafd685 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:03.514621 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887c40-83c9-4901-9243-b1b3eaafd685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:03.546253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-ce887c40-83c9-4901-9243-b1b3eaafd685 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:03.548308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ce887c40-83c9-4901-9243-b1b3eaafd685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:03.562304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1262/2474] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:03.567348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175eee80-444a-4159-a894-8dc05875a56b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:03.578470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175eee80-444a-4159-a894-8dc05875a56b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:03.584705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47cc0a-b8b8-410d-b137-f14b248b426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:03.585446 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47cc0a-b8b8-410d-b137-f14b248b426b admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:03.585768 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47cc0a-b8b8-410d-b137-f14b248b426b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:03.586160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47cc0a-b8b8-410d-b137-f14b248b426b admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:03.586960 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47cc0a-b8b8-410d-b137-f14b248b426b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:32:03.587268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47cc0a-b8b8-410d-b137-f14b248b426b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:03.589002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47cc0a-b8b8-410d-b137-f14b248b426b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:03.604296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1213/2475] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:32:03.609619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce887c40-83c9-4901-9243-b1b3eaafd685 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:03.623501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce887c40-83c9-4901-9243-b1b3eaafd685 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:03.631213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7d67d-5fd9-4d3a-bd54-318600663d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:03.632327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7d67d-5fd9-4d3a-bd54-318600663d56 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:03.632791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7d67d-5fd9-4d3a-bd54-318600663d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:03.633254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7d67d-5fd9-4d3a-bd54-318600663d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:03.634550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7d67d-5fd9-4d3a-bd54-318600663d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:03.638245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7d67d-5fd9-4d3a-bd54-318600663d56 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:03.681513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1263/2476] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:03 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:03.688407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47cc0a-b8b8-410d-b137-f14b248b426b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:03.706134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47cc0a-b8b8-410d-b137-f14b248b426b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:03.757679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:03.813390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c825-4293-499c-bfad-c1afbe3f0ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:03.814099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c825-4293-499c-bfad-c1afbe3f0ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:03.814379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c825-4293-499c-bfad-c1afbe3f0ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:03.814670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c825-4293-499c-bfad-c1afbe3f0ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:03.815404 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c825-4293-499c-bfad-c1afbe3f0ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:03.817391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c825-4293-499c-bfad-c1afbe3f0ec7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:03.842836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1214/2477] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:03 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:03.848855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7d67d-5fd9-4d3a-bd54-318600663d56 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:03.860327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7d67d-5fd9-4d3a-bd54-318600663d56 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:03.866151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2493c9-e10a-4d91-8bcd-0a9f2a49b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:03.866992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2493c9-e10a-4d91-8bcd-0a9f2a49b84e admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:03.867273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2493c9-e10a-4d91-8bcd-0a9f2a49b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:03.867545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2493c9-e10a-4d91-8bcd-0a9f2a49b84e admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:03.868294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2493c9-e10a-4d91-8bcd-0a9f2a49b84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:03.869977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2493c9-e10a-4d91-8bcd-0a9f2a49b84e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:03.883228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1264/2478] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:03.888181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c825-4293-499c-bfad-c1afbe3f0ec7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:03.899999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c825-4293-499c-bfad-c1afbe3f0ec7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:03.906168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1768b-63c8-4b3e-9c56-3db67025e7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:03.906978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1768b-63c8-4b3e-9c56-3db67025e7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:03.907299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1768b-63c8-4b3e-9c56-3db67025e7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:03.907609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1768b-63c8-4b3e-9c56-3db67025e7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:03.908402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1768b-63c8-4b3e-9c56-3db67025e7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:03.910139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1768b-63c8-4b3e-9c56-3db67025e7cf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:03.922952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1215/2479] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:03.927969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2493c9-e10a-4d91-8bcd-0a9f2a49b84e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:03.939961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2493c9-e10a-4d91-8bcd-0a9f2a49b84e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:03.945976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323d615-d8f6-4f9f-9706-2b9f14bfb866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:03.946967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323d615-d8f6-4f9f-9706-2b9f14bfb866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:03.947247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323d615-d8f6-4f9f-9706-2b9f14bfb866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:03.947518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323d615-d8f6-4f9f-9706-2b9f14bfb866 admin admin] PATH_INFO: `/v3/projects/7ea15d9ce72f4155a2ea499764fcca59/users/30984e9ee873403d807c34e3adf010aa/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:03.968140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323d615-d8f6-4f9f-9706-2b9f14bfb866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea15d9ce72f4155a2ea499764fcca59, user_id=30984e9ee873403d807c34e3adf010aa, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:03.971158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323d615-d8f6-4f9f-9706-2b9f14bfb866 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:03.975126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:03.995524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1265/2480] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:03 2022] PUT /identity/v3/projects/7ea15d9ce72f4155a2ea499764fcca59/users/30984e9ee873403d807c34e3adf010aa/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:04.010831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe14d66-103b-40dd-9115-0acd940293b6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:04.011100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe14d66-103b-40dd-9115-0acd940293b6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:04.011509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe14d66-103b-40dd-9115-0acd940293b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:04.053055 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-efe14d66-103b-40dd-9115-0acd940293b6 None None] MFA Rules not processed for user `30984e9ee873403d807c34e3adf010aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:04.054381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-efe14d66-103b-40dd-9115-0acd940293b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:04.135811 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1216/2481] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:04.141222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323d615-d8f6-4f9f-9706-2b9f14bfb866 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:04.239939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323d615-d8f6-4f9f-9706-2b9f14bfb866 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:04.248325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607b0c-890f-494a-bd87-a1e9bf7a8950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:04.249477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607b0c-890f-494a-bd87-a1e9bf7a8950 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:04.249977 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607b0c-890f-494a-bd87-a1e9bf7a8950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:04.250475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607b0c-890f-494a-bd87-a1e9bf7a8950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:04.251769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60607b0c-890f-494a-bd87-a1e9bf7a8950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:04.255769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60607b0c-890f-494a-bd87-a1e9bf7a8950 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:04.291045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1266/2482] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:04 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:04.295622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe14d66-103b-40dd-9115-0acd940293b6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:04.307989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe14d66-103b-40dd-9115-0acd940293b6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:04.376945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7779f1d-94e5-4839-bf56-ca3282dfa18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:04.377657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7779f1d-94e5-4839-bf56-ca3282dfa18b admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:04.377936 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7779f1d-94e5-4839-bf56-ca3282dfa18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:04.378205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7779f1d-94e5-4839-bf56-ca3282dfa18b admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:04.378977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7779f1d-94e5-4839-bf56-ca3282dfa18b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:04.380994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7779f1d-94e5-4839-bf56-ca3282dfa18b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:04.410379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1217/2483] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:04 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:04.418762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607b0c-890f-494a-bd87-a1e9bf7a8950 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:04.432917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607b0c-890f-494a-bd87-a1e9bf7a8950 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:04.439160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee9d27-6508-48bb-9f89-099e327700f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:04.439881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee9d27-6508-48bb-9f89-099e327700f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:04.440163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee9d27-6508-48bb-9f89-099e327700f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:04.440437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee9d27-6508-48bb-9f89-099e327700f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:04.441187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee9d27-6508-48bb-9f89-099e327700f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:04.442919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee9d27-6508-48bb-9f89-099e327700f7 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:04.456177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1267/2484] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:04.461098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7779f1d-94e5-4839-bf56-ca3282dfa18b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:04.474557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7779f1d-94e5-4839-bf56-ca3282dfa18b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:04.480415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec958c2-f6c7-46f2-a30c-09c7fce9ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:04.481374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec958c2-f6c7-46f2-a30c-09c7fce9ec2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:04.481654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec958c2-f6c7-46f2-a30c-09c7fce9ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:04.481927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec958c2-f6c7-46f2-a30c-09c7fce9ec2b admin admin] PATH_INFO: `/v3/projects/12c806315a9041a5bf35da095025f88a/users/ae81d861ddb14dd3b6b6089ea6440f07/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:04.502328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec958c2-f6c7-46f2-a30c-09c7fce9ec2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c806315a9041a5bf35da095025f88a, user_id=ae81d861ddb14dd3b6b6089ea6440f07, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:04.505547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec958c2-f6c7-46f2-a30c-09c7fce9ec2b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:04.524486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1218/2485] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:04 2022] PUT /identity/v3/projects/12c806315a9041a5bf35da095025f88a/users/ae81d861ddb14dd3b6b6089ea6440f07/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:04.529648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee9d27-6508-48bb-9f89-099e327700f7 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:04.541007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee9d27-6508-48bb-9f89-099e327700f7 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:04.623850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b44a8-4a77-4d5d-b1a1-02d98ee57f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:04.623850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b44a8-4a77-4d5d-b1a1-02d98ee57f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:04.623850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b44a8-4a77-4d5d-b1a1-02d98ee57f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:04.623850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b44a8-4a77-4d5d-b1a1-02d98ee57f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:04.624825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b44a8-4a77-4d5d-b1a1-02d98ee57f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:04.624825 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b44a8-4a77-4d5d-b1a1-02d98ee57f38 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:04.634784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1268/2486] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:32:04.641252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec958c2-f6c7-46f2-a30c-09c7fce9ec2b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:04.649914 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:04.660374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec958c2-f6c7-46f2-a30c-09c7fce9ec2b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:04.666080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42461-b08e-4068-aaa1-0df8a2c03a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:04.667057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42461-b08e-4068-aaa1-0df8a2c03a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:04.667343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42461-b08e-4068-aaa1-0df8a2c03a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:04.667622 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42461-b08e-4068-aaa1-0df8a2c03a64 admin admin] PATH_INFO: `/v3/projects/12c806315a9041a5bf35da095025f88a/users/ae81d861ddb14dd3b6b6089ea6440f07/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:04.669888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42461-b08e-4068-aaa1-0df8a2c03a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c806315a9041a5bf35da095025f88a, user_id=ae81d861ddb14dd3b6b6089ea6440f07, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:04.675418 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42461-b08e-4068-aaa1-0df8a2c03a64 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:04.695269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1219/2487] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:04 2022] PUT /identity/v3/projects/12c806315a9041a5bf35da095025f88a/users/ae81d861ddb14dd3b6b6089ea6440f07/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:04.706472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc04a19-3b48-46f6-a5a6-bf1d3a035779 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:04.706898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc04a19-3b48-46f6-a5a6-bf1d3a035779 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:04.707265 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc04a19-3b48-46f6-a5a6-bf1d3a035779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:04.739773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-cbc04a19-3b48-46f6-a5a6-bf1d3a035779 None None] MFA Rules not processed for user `ae81d861ddb14dd3b6b6089ea6440f07`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:04.741700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cbc04a19-3b48-46f6-a5a6-bf1d3a035779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:04.809872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:04.836781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1269/2488] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:04 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:04.852318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42461-b08e-4068-aaa1-0df8a2c03a64 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:04.855352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bea42461-b08e-4068-aaa1-0df8a2c03a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:04.936129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42461-b08e-4068-aaa1-0df8a2c03a64 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:04.942970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c68af0-5639-4580-9f2e-90cfa817c040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:04.944007 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c68af0-5639-4580-9f2e-90cfa817c040 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:04.944436 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c68af0-5639-4580-9f2e-90cfa817c040 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:04.944857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c68af0-5639-4580-9f2e-90cfa817c040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:04.960879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c68af0-5639-4580-9f2e-90cfa817c040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:04.962426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c68af0-5639-4580-9f2e-90cfa817c040 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:04.977157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1220/2489] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:04 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:05.034089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc04a19-3b48-46f6-a5a6-bf1d3a035779 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:05.035924 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cbc04a19-3b48-46f6-a5a6-bf1d3a035779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:05.049162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc04a19-3b48-46f6-a5a6-bf1d3a035779 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:05.053244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe2101-8a49-4bc8-b5be-7a39343fa488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:05.053939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe2101-8a49-4bc8-b5be-7a39343fa488 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:05.054221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe2101-8a49-4bc8-b5be-7a39343fa488 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:05.054478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe2101-8a49-4bc8-b5be-7a39343fa488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:05.126658 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe2101-8a49-4bc8-b5be-7a39343fa488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:05.128196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe2101-8a49-4bc8-b5be-7a39343fa488 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:05.139309 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1270/2490] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:08.802533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c68af0-5639-4580-9f2e-90cfa817c040 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:08.907607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c68af0-5639-4580-9f2e-90cfa817c040 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:08.914458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:08.915769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:08.916114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:08.916445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] PATH_INFO: `/v3/users/30984e9ee873403d807c34e3adf010aa` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:08.917986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30984e9ee873403d807c34e3adf010aa)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:08.920036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:08.988787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30984e9ee873403d807c34e3adf010aa'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.001454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30984e9ee873403d807c34e3adf010aa'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.002362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30984e9ee873403d807c34e3adf010aa'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.024492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30984e9ee873403d807c34e3adf010aa'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.040513 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30984e9ee873403d807c34e3adf010aa'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.052827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1221/2491] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:08 2022] DELETE /identity/v3/users/30984e9ee873403d807c34e3adf010aa => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:09.058867 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dba9b-b2bf-4214-9ebc-584f5f27b8e2 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:09.059497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dba9b-b2bf-4214-9ebc-584f5f27b8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:09.059497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dba9b-b2bf-4214-9ebc-584f5f27b8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:09.080637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-8c6dba9b-b2bf-4214-9ebc-584f5f27b8e2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:09.081986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8c6dba9b-b2bf-4214-9ebc-584f5f27b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:09.155375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1271/2492] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:09.167006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:09.168745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:09.186816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:09.243874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6527a-b9f6-454c-a125-3645cbe72ec7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:09.248674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bebe5b-cd7c-4df1-95cd-5c90400d8c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:09.249481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bebe5b-cd7c-4df1-95cd-5c90400d8c0b service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:09.249780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bebe5b-cd7c-4df1-95cd-5c90400d8c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:09.250052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bebe5b-cd7c-4df1-95cd-5c90400d8c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:09.261144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bebe5b-cd7c-4df1-95cd-5c90400d8c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:09.262702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bebe5b-cd7c-4df1-95cd-5c90400d8c0b service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:09.274582 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1222/2493] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:09.602129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dba9b-b2bf-4214-9ebc-584f5f27b8e2 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:09.604511 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8c6dba9b-b2bf-4214-9ebc-584f5f27b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:09.624870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dba9b-b2bf-4214-9ebc-584f5f27b8e2 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:09.632218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:09.633553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:09.634016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:09.634283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] PATH_INFO: `/v3/projects/7ea15d9ce72f4155a2ea499764fcca59` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:09.636316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea15d9ce72f4155a2ea499764fcca59)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:09.639326 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:09.717254 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea15d9ce72f4155a2ea499764fcca59', 'request_id': 'req-9e65f148-b686-41d5-9a96-ab0e24e2261a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.729555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea15d9ce72f4155a2ea499764fcca59', 'request_id': 'req-9e65f148-b686-41d5-9a96-ab0e24e2261a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.742187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea15d9ce72f4155a2ea499764fcca59', 'request_id': 'req-9e65f148-b686-41d5-9a96-ab0e24e2261a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.759686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] The token cache is being invalidate because project 7ea15d9ce72f4155a2ea499764fcca59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:09.760111 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.760963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.762922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1272/2494] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:09 2022] DELETE /identity/v3/projects/7ea15d9ce72f4155a2ea499764fcca59 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:09.767669 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bebe5b-cd7c-4df1-95cd-5c90400d8c0b service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:09.779954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bebe5b-cd7c-4df1-95cd-5c90400d8c0b service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:09.851228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:09.852629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:09.853001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:09.853376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] PATH_INFO: `/v3/users/ae81d861ddb14dd3b6b6089ea6440f07` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:09.854999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae81d861ddb14dd3b6b6089ea6440f07)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:09.857134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:09.915323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae81d861ddb14dd3b6b6089ea6440f07'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.929195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae81d861ddb14dd3b6b6089ea6440f07'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.930172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae81d861ddb14dd3b6b6089ea6440f07'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.947890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae81d861ddb14dd3b6b6089ea6440f07'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.957367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1703c04b-2153-4e65-833c-ea71b34827fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae81d861ddb14dd3b6b6089ea6440f07'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:09.964995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1223/2495] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:09 2022] DELETE /identity/v3/users/ae81d861ddb14dd3b6b6089ea6440f07 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:10.368772 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:10.371249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:10.395734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f148-b686-41d5-9a96-ab0e24e2261a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:10.413912 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:10.490481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:10.491484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:10.491652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:10.491945 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] PATH_INFO: `/v3/projects/12c806315a9041a5bf35da095025f88a` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:10.493310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c806315a9041a5bf35da095025f88a)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:10.495374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:10.552660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c806315a9041a5bf35da095025f88a', 'request_id': 'req-46d618da-c89c-4de0-870d-cdfec5a87ffc'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:10.563068 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c806315a9041a5bf35da095025f88a', 'request_id': 'req-46d618da-c89c-4de0-870d-cdfec5a87ffc'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:10.571391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c806315a9041a5bf35da095025f88a', 'request_id': 'req-46d618da-c89c-4de0-870d-cdfec5a87ffc'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:10.584370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] The token cache is being invalidate because project 12c806315a9041a5bf35da095025f88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:10.584715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:10.585351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-46d618da-c89c-4de0-870d-cdfec5a87ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:10.587051 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1273/2496] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:10 2022] DELETE /identity/v3/projects/12c806315a9041a5bf35da095025f88a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:10.592396 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ac19-df39-4ebe-a6a9-e56fb36a4f7f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:10.592739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ac19-df39-4ebe-a6a9-e56fb36a4f7f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:10.593018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ac19-df39-4ebe-a6a9-e56fb36a4f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:10.613320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-32e5ac19-df39-4ebe-a6a9-e56fb36a4f7f None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:10.614919 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-32e5ac19-df39-4ebe-a6a9-e56fb36a4f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:10.656649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:10.703137 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1224/2497] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:10.713702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813df73-ddf2-41d3-b4c6-970941e386a7 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:10.714173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813df73-ddf2-41d3-b4c6-970941e386a7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:10.714952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813df73-ddf2-41d3-b4c6-970941e386a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:10.746821 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-2813df73-ddf2-41d3-b4c6-970941e386a7 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:10.749664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-2813df73-ddf2-41d3-b4c6-970941e386a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:10.765410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1274/2498] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:10.771704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ac19-df39-4ebe-a6a9-e56fb36a4f7f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:10.783553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ac19-df39-4ebe-a6a9-e56fb36a4f7f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:10.789623 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc6a0d-f143-4560-90d0-5204f3ae7178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:10.790519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6a0d-f143-4560-90d0-5204f3ae7178 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:10.791218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6a0d-f143-4560-90d0-5204f3ae7178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:10.791511 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6a0d-f143-4560-90d0-5204f3ae7178 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:10.792304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc6a0d-f143-4560-90d0-5204f3ae7178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:32:10.792638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc6a0d-f143-4560-90d0-5204f3ae7178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:10.794384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc6a0d-f143-4560-90d0-5204f3ae7178 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:10.808538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1225/2499] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:32:10.813864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813df73-ddf2-41d3-b4c6-970941e386a7 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:10.824280 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813df73-ddf2-41d3-b4c6-970941e386a7 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:10.830025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793182e-7deb-408c-9c7e-3dc2dae31d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:10.830764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793182e-7deb-408c-9c7e-3dc2dae31d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:10.831046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793182e-7deb-408c-9c7e-3dc2dae31d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:10.831317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793182e-7deb-408c-9c7e-3dc2dae31d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:10.832024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793182e-7deb-408c-9c7e-3dc2dae31d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:10.834035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793182e-7deb-408c-9c7e-3dc2dae31d3f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:10.866036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1275/2500] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:10 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:10.871662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc6a0d-f143-4560-90d0-5204f3ae7178 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:10.888579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc6a0d-f143-4560-90d0-5204f3ae7178 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:10.976957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae4be9-fe7a-4b3a-a641-d6808087ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:10.978098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae4be9-fe7a-4b3a-a641-d6808087ad34 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:10.978665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae4be9-fe7a-4b3a-a641-d6808087ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:10.979146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae4be9-fe7a-4b3a-a641-d6808087ad34 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:10.980427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae4be9-fe7a-4b3a-a641-d6808087ad34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:10.983264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae4be9-fe7a-4b3a-a641-d6808087ad34 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:11.020678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1226/2501] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:10 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:11.026081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793182e-7deb-408c-9c7e-3dc2dae31d3f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:11.044724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793182e-7deb-408c-9c7e-3dc2dae31d3f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:11.052459 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978b59e-979a-4ffa-b645-cc736ae05cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:11.053624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978b59e-979a-4ffa-b645-cc736ae05cef admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.054127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978b59e-979a-4ffa-b645-cc736ae05cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.054662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978b59e-979a-4ffa-b645-cc736ae05cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.056078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978b59e-979a-4ffa-b645-cc736ae05cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:11.059089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978b59e-979a-4ffa-b645-cc736ae05cef admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:11.081054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1276/2502] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:11.085790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae4be9-fe7a-4b3a-a641-d6808087ad34 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:11.097635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae4be9-fe7a-4b3a-a641-d6808087ad34 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:11.103665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af40a84-bb53-4859-84bc-0059fb14458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:11.104488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af40a84-bb53-4859-84bc-0059fb14458b admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.104869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af40a84-bb53-4859-84bc-0059fb14458b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.105236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af40a84-bb53-4859-84bc-0059fb14458b admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.106111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af40a84-bb53-4859-84bc-0059fb14458b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:11.108031 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af40a84-bb53-4859-84bc-0059fb14458b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:11.120750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1227/2503] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:11.126742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978b59e-979a-4ffa-b645-cc736ae05cef admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:11.138779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978b59e-979a-4ffa-b645-cc736ae05cef admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:11.144769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6613b3f-b187-40d6-a5a9-a7008f8de957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:11.145713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6613b3f-b187-40d6-a5a9-a7008f8de957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.145987 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6613b3f-b187-40d6-a5a9-a7008f8de957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.146249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6613b3f-b187-40d6-a5a9-a7008f8de957 admin admin] PATH_INFO: `/v3/projects/102c4537095d44fa87652bebbbf8587d/users/975f61c7e3c147c5ba51ea77eb5f49e0/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.165162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6613b3f-b187-40d6-a5a9-a7008f8de957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102c4537095d44fa87652bebbbf8587d, user_id=975f61c7e3c147c5ba51ea77eb5f49e0, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:11.168154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6613b3f-b187-40d6-a5a9-a7008f8de957 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:11.187462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1277/2504] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:11 2022] PUT /identity/v3/projects/102c4537095d44fa87652bebbbf8587d/users/975f61c7e3c147c5ba51ea77eb5f49e0/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:11.200904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e02d-1f1f-4cb9-aea7-8e3d9ace011a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.201260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e02d-1f1f-4cb9-aea7-8e3d9ace011a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.201553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e02d-1f1f-4cb9-aea7-8e3d9ace011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.233698 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b3a6e02d-1f1f-4cb9-aea7-8e3d9ace011a None None] MFA Rules not processed for user `975f61c7e3c147c5ba51ea77eb5f49e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:11.234995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b3a6e02d-1f1f-4cb9-aea7-8e3d9ace011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:11.333039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1228/2505] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:11.338381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6613b3f-b187-40d6-a5a9-a7008f8de957 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:11.405624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:11.435530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6613b3f-b187-40d6-a5a9-a7008f8de957 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:11.441608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06882f7-b9f4-40a9-b389-5e47e9994fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:11.442473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06882f7-b9f4-40a9-b389-5e47e9994fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.442847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06882f7-b9f4-40a9-b389-5e47e9994fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.443159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06882f7-b9f4-40a9-b389-5e47e9994fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.444004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06882f7-b9f4-40a9-b389-5e47e9994fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:11.446236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06882f7-b9f4-40a9-b389-5e47e9994fb0 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:11.479877 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1278/2506] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:11 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:11.484716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6e02d-1f1f-4cb9-aea7-8e3d9ace011a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:11.497398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6e02d-1f1f-4cb9-aea7-8e3d9ace011a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:11.529758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:11.571353 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f222286-878f-4bcf-9a7b-2e5af7beda07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:11.572153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222286-878f-4bcf-9a7b-2e5af7beda07 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.572529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222286-878f-4bcf-9a7b-2e5af7beda07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.572916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222286-878f-4bcf-9a7b-2e5af7beda07 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.573735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f222286-878f-4bcf-9a7b-2e5af7beda07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:11.576060 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f222286-878f-4bcf-9a7b-2e5af7beda07 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:11.602519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1229/2507] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:11 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:11.607108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06882f7-b9f4-40a9-b389-5e47e9994fb0 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:11.620446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06882f7-b9f4-40a9-b389-5e47e9994fb0 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:11.627293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166c7ea-44cc-4872-ad29-f29e7aa2af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:11.628065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c7ea-44cc-4872-ad29-f29e7aa2af4a admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.628758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c7ea-44cc-4872-ad29-f29e7aa2af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.629204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c7ea-44cc-4872-ad29-f29e7aa2af4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.630475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166c7ea-44cc-4872-ad29-f29e7aa2af4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:11.632971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166c7ea-44cc-4872-ad29-f29e7aa2af4a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:11.647445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1279/2508] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:32:11.652481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f222286-878f-4bcf-9a7b-2e5af7beda07 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:11.664901 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f222286-878f-4bcf-9a7b-2e5af7beda07 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:11.670678 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9b8a4-1f44-4686-b4be-611c5127a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:11.671659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b8a4-1f44-4686-b4be-611c5127a881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.671983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b8a4-1f44-4686-b4be-611c5127a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.672297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b8a4-1f44-4686-b4be-611c5127a881 admin admin] PATH_INFO: `/v3/projects/2ec55df61d23459085855c367403c266/users/ac7143cd7a6d4aaa8398523be2763ff6/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.691892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9b8a4-1f44-4686-b4be-611c5127a881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec55df61d23459085855c367403c266, user_id=ac7143cd7a6d4aaa8398523be2763ff6, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:11.694795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9b8a4-1f44-4686-b4be-611c5127a881 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:11.716486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1230/2509] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:11 2022] PUT /identity/v3/projects/2ec55df61d23459085855c367403c266/users/ac7143cd7a6d4aaa8398523be2763ff6/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:11.723020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166c7ea-44cc-4872-ad29-f29e7aa2af4a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:11.741764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166c7ea-44cc-4872-ad29-f29e7aa2af4a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:11.851496 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123a35-736c-4508-ba11-82eee4cca0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:11.852725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123a35-736c-4508-ba11-82eee4cca0ec admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.853140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123a35-736c-4508-ba11-82eee4cca0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.853879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123a35-736c-4508-ba11-82eee4cca0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.855537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123a35-736c-4508-ba11-82eee4cca0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:11.859210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123a35-736c-4508-ba11-82eee4cca0ec admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:11.875770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1280/2510] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:11.880454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9b8a4-1f44-4686-b4be-611c5127a881 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:11.892513 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9b8a4-1f44-4686-b4be-611c5127a881 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:11.899290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f6fff-d01f-4edd-9784-b1d4b1ead6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:11.900314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f6fff-d01f-4edd-9784-b1d4b1ead6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.900689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f6fff-d01f-4edd-9784-b1d4b1ead6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.901022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f6fff-d01f-4edd-9784-b1d4b1ead6e4 admin admin] PATH_INFO: `/v3/projects/2ec55df61d23459085855c367403c266/users/ac7143cd7a6d4aaa8398523be2763ff6/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.904264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f6fff-d01f-4edd-9784-b1d4b1ead6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec55df61d23459085855c367403c266, user_id=ac7143cd7a6d4aaa8398523be2763ff6, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:11.907438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f6fff-d01f-4edd-9784-b1d4b1ead6e4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:11.920623 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1231/2511] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:11 2022] PUT /identity/v3/projects/2ec55df61d23459085855c367403c266/users/ac7143cd7a6d4aaa8398523be2763ff6/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:11.939968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c0cc7-c195-4d4c-b919-b147117d1a91 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:11.940285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c0cc7-c195-4d4c-b919-b147117d1a91 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:11.940633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c0cc7-c195-4d4c-b919-b147117d1a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:11.973689 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-b84c0cc7-c195-4d4c-b919-b147117d1a91 None None] MFA Rules not processed for user `ac7143cd7a6d4aaa8398523be2763ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:11.975120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b84c0cc7-c195-4d4c-b919-b147117d1a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:12.065887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1281/2512] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:12.078061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f6fff-d01f-4edd-9784-b1d4b1ead6e4 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:12.080364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bf4f6fff-d01f-4edd-9784-b1d4b1ead6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:12.153374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f6fff-d01f-4edd-9784-b1d4b1ead6e4 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:12.158255 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7ca9d-5fa9-4997-adf3-44a80c5a643c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:12.159159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7ca9d-5fa9-4997-adf3-44a80c5a643c service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:12.159565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7ca9d-5fa9-4997-adf3-44a80c5a643c service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:12.159925 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7ca9d-5fa9-4997-adf3-44a80c5a643c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:12.171318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7ca9d-5fa9-4997-adf3-44a80c5a643c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:12.172861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7ca9d-5fa9-4997-adf3-44a80c5a643c service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:12.184384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1232/2513] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:12.610808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c0cc7-c195-4d4c-b919-b147117d1a91 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:12.670925 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:12.707806 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c0cc7-c195-4d4c-b919-b147117d1a91 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:12.714136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:12.715155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:12.715471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:12.715750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] PATH_INFO: `/v3/users/975f61c7e3c147c5ba51ea77eb5f49e0` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:12.717339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] RBAC: Authorizing `identity:delete_user(user_id=975f61c7e3c147c5ba51ea77eb5f49e0)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:12.719641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:12.778862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975f61c7e3c147c5ba51ea77eb5f49e0'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:12.779830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975f61c7e3c147c5ba51ea77eb5f49e0'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:12.780610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975f61c7e3c147c5ba51ea77eb5f49e0'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:12.797438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975f61c7e3c147c5ba51ea77eb5f49e0'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:12.808058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975f61c7e3c147c5ba51ea77eb5f49e0'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:12.823988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1282/2514] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:12 2022] DELETE /identity/v3/users/975f61c7e3c147c5ba51ea77eb5f49e0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:12.829481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569381-0149-4377-a293-f69f90f62f79 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:12.829856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569381-0149-4377-a293-f69f90f62f79 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:12.830172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569381-0149-4377-a293-f69f90f62f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:12.851080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-20569381-0149-4377-a293-f69f90f62f79 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:12.852483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-20569381-0149-4377-a293-f69f90f62f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:12.931515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1233/2515] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:32:12.942876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:12.944854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:13.027034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6897e4-7381-485d-9d36-6b7afd99181b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:13.032477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9495851-ff2f-44a6-b6f2-f62fbecf2983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:13.033255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495851-ff2f-44a6-b6f2-f62fbecf2983 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:13.033591 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495851-ff2f-44a6-b6f2-f62fbecf2983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:13.033921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495851-ff2f-44a6-b6f2-f62fbecf2983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:13.045092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9495851-ff2f-44a6-b6f2-f62fbecf2983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:13.046821 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9495851-ff2f-44a6-b6f2-f62fbecf2983 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:13.059323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1283/2516] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:13.391762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20569381-0149-4377-a293-f69f90f62f79 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:13.393667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-20569381-0149-4377-a293-f69f90f62f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:13.413616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20569381-0149-4377-a293-f69f90f62f79 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:13.420584 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:13.423245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:13.423772 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:13.423970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] PATH_INFO: `/v3/projects/102c4537095d44fa87652bebbbf8587d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:13.425894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=102c4537095d44fa87652bebbbf8587d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:13.428394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:13.457712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:13.489543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102c4537095d44fa87652bebbbf8587d', 'request_id': 'req-3ad95b09-1cf8-454c-aca7-8fa7447501ac'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:13.496474 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102c4537095d44fa87652bebbbf8587d', 'request_id': 'req-3ad95b09-1cf8-454c-aca7-8fa7447501ac'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:13.507658 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102c4537095d44fa87652bebbbf8587d', 'request_id': 'req-3ad95b09-1cf8-454c-aca7-8fa7447501ac'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:13.529539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] The token cache is being invalidate because project 102c4537095d44fa87652bebbbf8587d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:13.530153 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:13.531015 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:13.532798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1234/2517] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:13 2022] DELETE /identity/v3/projects/102c4537095d44fa87652bebbbf8587d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:13.537800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9495851-ff2f-44a6-b6f2-f62fbecf2983 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:13.549700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9495851-ff2f-44a6-b6f2-f62fbecf2983 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:13.612241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:13.621934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:13.623248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:13.623530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:13.623867 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] PATH_INFO: `/v3/users/ac7143cd7a6d4aaa8398523be2763ff6` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:13.625310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7143cd7a6d4aaa8398523be2763ff6)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:13.627382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:13.688971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7143cd7a6d4aaa8398523be2763ff6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:13.689819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7143cd7a6d4aaa8398523be2763ff6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:13.690536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7143cd7a6d4aaa8398523be2763ff6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:13.706491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7143cd7a6d4aaa8398523be2763ff6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:13.716366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f35d3201-12bd-4382-a764-38c778443bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7143cd7a6d4aaa8398523be2763ff6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:13.732334 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1284/2518] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:13 2022] DELETE /identity/v3/users/ac7143cd7a6d4aaa8398523be2763ff6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:14.080567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:14.082129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:14.098984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad95b09-1cf8-454c-aca7-8fa7447501ac admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:14.172423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:14.173318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:14.173603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:14.173916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] PATH_INFO: `/v3/projects/2ec55df61d23459085855c367403c266` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:14.175329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec55df61d23459085855c367403c266)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:14.177351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:14.234137 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec55df61d23459085855c367403c266', 'request_id': 'req-1930d591-75b0-4a60-b83b-ee6061e5b2b1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:14.241518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec55df61d23459085855c367403c266', 'request_id': 'req-1930d591-75b0-4a60-b83b-ee6061e5b2b1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:14.256733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec55df61d23459085855c367403c266', 'request_id': 'req-1930d591-75b0-4a60-b83b-ee6061e5b2b1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:14.270568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] The token cache is being invalidate because project 2ec55df61d23459085855c367403c266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:14.270862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:14.271557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1930d591-75b0-4a60-b83b-ee6061e5b2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:14.273194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1235/2519] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:14 2022] DELETE /identity/v3/projects/2ec55df61d23459085855c367403c266 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:32:14.279468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3da2c-0387-44d3-97ee-599901f26864 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:14.279837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3da2c-0387-44d3-97ee-599901f26864 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:14.280168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3da2c-0387-44d3-97ee-599901f26864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:14.302914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-09c3da2c-0387-44d3-97ee-599901f26864 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:14.304259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-09c3da2c-0387-44d3-97ee-599901f26864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:14.375146 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1285/2520] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:14.386039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795874c1-4841-43a8-bd39-2d63bcb9c387 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:14.386441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795874c1-4841-43a8-bd39-2d63bcb9c387 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:14.386838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795874c1-4841-43a8-bd39-2d63bcb9c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:14.416011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-795874c1-4841-43a8-bd39-2d63bcb9c387 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:14.417476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-795874c1-4841-43a8-bd39-2d63bcb9c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:14.428757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1236/2521] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:14.433882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3da2c-0387-44d3-97ee-599901f26864 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:14.446013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3da2c-0387-44d3-97ee-599901f26864 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:14.452178 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edabfc-b1fb-4d76-8615-18a8684d4b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:14.452891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edabfc-b1fb-4d76-8615-18a8684d4b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:14.453177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edabfc-b1fb-4d76-8615-18a8684d4b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:14.453449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edabfc-b1fb-4d76-8615-18a8684d4b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:14.454201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edabfc-b1fb-4d76-8615-18a8684d4b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:32:14.454531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edabfc-b1fb-4d76-8615-18a8684d4b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:14.456243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edabfc-b1fb-4d76-8615-18a8684d4b90 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:14.471085 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1286/2522] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:32:14.476185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795874c1-4841-43a8-bd39-2d63bcb9c387 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:14.486897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795874c1-4841-43a8-bd39-2d63bcb9c387 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:14.492232 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25872c-08e3-4301-8d34-1dcd5a9a223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:14.492929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25872c-08e3-4301-8d34-1dcd5a9a223e admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:14.493220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25872c-08e3-4301-8d34-1dcd5a9a223e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:14.493497 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25872c-08e3-4301-8d34-1dcd5a9a223e admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:14.494217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25872c-08e3-4301-8d34-1dcd5a9a223e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:14.496242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25872c-08e3-4301-8d34-1dcd5a9a223e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:14.528464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1237/2523] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:14 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:14.532685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edabfc-b1fb-4d76-8615-18a8684d4b90 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:14.548600 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edabfc-b1fb-4d76-8615-18a8684d4b90 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:14.623468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b80c-f1e6-4a4b-b690-5450d76b1bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:14.624468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b80c-f1e6-4a4b-b690-5450d76b1bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:14.624699 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b80c-f1e6-4a4b-b690-5450d76b1bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:14.625020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b80c-f1e6-4a4b-b690-5450d76b1bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:14.625823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b80c-f1e6-4a4b-b690-5450d76b1bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:14.627944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b80c-f1e6-4a4b-b690-5450d76b1bd8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:14.641326 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:14.661106 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1287/2524] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:14 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:14.665220 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25872c-08e3-4301-8d34-1dcd5a9a223e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:14.677348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25872c-08e3-4301-8d34-1dcd5a9a223e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:14.682842 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820dfa7-45a8-4856-bb48-df4384127ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:14.683560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820dfa7-45a8-4856-bb48-df4384127ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:14.683847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820dfa7-45a8-4856-bb48-df4384127ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:14.684124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820dfa7-45a8-4856-bb48-df4384127ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:14.684915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820dfa7-45a8-4856-bb48-df4384127ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:14.687640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820dfa7-45a8-4856-bb48-df4384127ccb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:14.689424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:14.705118 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1238/2525] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:32:14.709476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b80c-f1e6-4a4b-b690-5450d76b1bd8 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:14.720762 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b80c-f1e6-4a4b-b690-5450d76b1bd8 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:14.725938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c88b-d9a3-4376-b9f1-d61ddc17b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:14.726688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c88b-d9a3-4376-b9f1-d61ddc17b576 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:14.726979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c88b-d9a3-4376-b9f1-d61ddc17b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:14.727267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c88b-d9a3-4376-b9f1-d61ddc17b576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:14.728025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330c88b-d9a3-4376-b9f1-d61ddc17b576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:14.729705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330c88b-d9a3-4376-b9f1-d61ddc17b576 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:14.741677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1288/2526] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:32:14.747008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820dfa7-45a8-4856-bb48-df4384127ccb admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:14.764443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820dfa7-45a8-4856-bb48-df4384127ccb admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:14.772566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bbccc-7173-4042-aef4-d5af50fbf0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:14.774050 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bbccc-7173-4042-aef4-d5af50fbf0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:14.774526 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bbccc-7173-4042-aef4-d5af50fbf0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:14.775023 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bbccc-7173-4042-aef4-d5af50fbf0c5 admin admin] PATH_INFO: `/v3/projects/cb76106da0274ace8b1ac39925675b11/users/d2ea2416947547a0bd1a309786b8f1db/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:14.802975 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bbccc-7173-4042-aef4-d5af50fbf0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb76106da0274ace8b1ac39925675b11, user_id=d2ea2416947547a0bd1a309786b8f1db, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:14.807955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bbccc-7173-4042-aef4-d5af50fbf0c5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:14.827872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1239/2527] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:14 2022] PUT /identity/v3/projects/cb76106da0274ace8b1ac39925675b11/users/d2ea2416947547a0bd1a309786b8f1db/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:14.839351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f240e3-5558-4d67-b798-ac53ddc65fbc None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:14.839707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f240e3-5558-4d67-b798-ac53ddc65fbc None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:14.840074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f240e3-5558-4d67-b798-ac53ddc65fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:14.872726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d3f240e3-5558-4d67-b798-ac53ddc65fbc None None] MFA Rules not processed for user `d2ea2416947547a0bd1a309786b8f1db`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:14.874295 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d3f240e3-5558-4d67-b798-ac53ddc65fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:14.953192 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1289/2528] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:14.957939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bbccc-7173-4042-aef4-d5af50fbf0c5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:15.033693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bbccc-7173-4042-aef4-d5af50fbf0c5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:15.039426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411f0d3-20fa-48d1-9bed-cfcaeedbbc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:15.040166 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411f0d3-20fa-48d1-9bed-cfcaeedbbc8d admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:15.040487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411f0d3-20fa-48d1-9bed-cfcaeedbbc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:15.040753 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411f0d3-20fa-48d1-9bed-cfcaeedbbc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:15.041507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411f0d3-20fa-48d1-9bed-cfcaeedbbc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:15.043546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411f0d3-20fa-48d1-9bed-cfcaeedbbc8d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:15.077314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1240/2529] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:14 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:32:15.079103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f240e3-5558-4d67-b798-ac53ddc65fbc None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:15.091531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f240e3-5558-4d67-b798-ac53ddc65fbc None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:15.159794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefb3e6-1e69-4e42-a3b2-5783d280aec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:15.160485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefb3e6-1e69-4e42-a3b2-5783d280aec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:15.160776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefb3e6-1e69-4e42-a3b2-5783d280aec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:15.161052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefb3e6-1e69-4e42-a3b2-5783d280aec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:15.161789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefb3e6-1e69-4e42-a3b2-5783d280aec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:15.163961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefb3e6-1e69-4e42-a3b2-5783d280aec1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:15.188933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1290/2530] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:15 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:15.193758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411f0d3-20fa-48d1-9bed-cfcaeedbbc8d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:15.205483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411f0d3-20fa-48d1-9bed-cfcaeedbbc8d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:15.211280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea60778-c7f2-410d-b730-bf3528953a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:15.211990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea60778-c7f2-410d-b730-bf3528953a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:15.212278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea60778-c7f2-410d-b730-bf3528953a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:15.212556 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea60778-c7f2-410d-b730-bf3528953a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:15.213310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea60778-c7f2-410d-b730-bf3528953a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:15.215047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea60778-c7f2-410d-b730-bf3528953a11 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:15.230632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1241/2531] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:32:15.235344 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefb3e6-1e69-4e42-a3b2-5783d280aec1 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:15.247018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefb3e6-1e69-4e42-a3b2-5783d280aec1 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:15.252472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53262-1565-4ec4-8086-9bf891a18c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:15.253405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53262-1565-4ec4-8086-9bf891a18c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:15.253693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53262-1565-4ec4-8086-9bf891a18c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:15.253971 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53262-1565-4ec4-8086-9bf891a18c48 admin admin] PATH_INFO: `/v3/projects/49f48c744fdc4f2b8320bd7796b27f8c/users/6c5344d99fe8404ba7959a43681b1bb0/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:15.272139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f53262-1565-4ec4-8086-9bf891a18c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f48c744fdc4f2b8320bd7796b27f8c, user_id=6c5344d99fe8404ba7959a43681b1bb0, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:15.275032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f53262-1565-4ec4-8086-9bf891a18c48 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:15.292662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1291/2532] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:15 2022] PUT /identity/v3/projects/49f48c744fdc4f2b8320bd7796b27f8c/users/6c5344d99fe8404ba7959a43681b1bb0/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:15.297854 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea60778-c7f2-410d-b730-bf3528953a11 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:15.309624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea60778-c7f2-410d-b730-bf3528953a11 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:15.384710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d42ef3-994d-454a-8b47-1d38e3204661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:15.385415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d42ef3-994d-454a-8b47-1d38e3204661 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:15.385694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d42ef3-994d-454a-8b47-1d38e3204661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:15.385965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d42ef3-994d-454a-8b47-1d38e3204661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:15.386750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d42ef3-994d-454a-8b47-1d38e3204661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:15.388419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d42ef3-994d-454a-8b47-1d38e3204661 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:15.401496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1242/2533] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:15.406764 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53262-1565-4ec4-8086-9bf891a18c48 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:15.418612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53262-1565-4ec4-8086-9bf891a18c48 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:15.423922 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad854665-9d5b-4fb8-8709-c4ca170b3d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:15.424847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad854665-9d5b-4fb8-8709-c4ca170b3d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:15.425136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad854665-9d5b-4fb8-8709-c4ca170b3d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:15.425410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad854665-9d5b-4fb8-8709-c4ca170b3d84 admin admin] PATH_INFO: `/v3/projects/49f48c744fdc4f2b8320bd7796b27f8c/users/6c5344d99fe8404ba7959a43681b1bb0/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:15.427676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad854665-9d5b-4fb8-8709-c4ca170b3d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f48c744fdc4f2b8320bd7796b27f8c, user_id=6c5344d99fe8404ba7959a43681b1bb0, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:15.430447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad854665-9d5b-4fb8-8709-c4ca170b3d84 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:15.443697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1292/2534] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:15 2022] PUT /identity/v3/projects/49f48c744fdc4f2b8320bd7796b27f8c/users/6c5344d99fe8404ba7959a43681b1bb0/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:15.462700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8ba19-78a8-4b30-97f0-99af14beedd7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:15.463213 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8ba19-78a8-4b30-97f0-99af14beedd7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:15.463657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8ba19-78a8-4b30-97f0-99af14beedd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:15.502062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-47e8ba19-78a8-4b30-97f0-99af14beedd7 None None] MFA Rules not processed for user `6c5344d99fe8404ba7959a43681b1bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:15.503407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-47e8ba19-78a8-4b30-97f0-99af14beedd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:15.547793 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:15.599428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1243/2535] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:15.612891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad854665-9d5b-4fb8-8709-c4ca170b3d84 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:15.615608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ad854665-9d5b-4fb8-8709-c4ca170b3d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:15.655878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:15.695526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad854665-9d5b-4fb8-8709-c4ca170b3d84 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:15.700238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1991-7aed-467f-8ee5-95a826be6b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:15.701051 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1991-7aed-467f-8ee5-95a826be6b0b service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:15.701421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1991-7aed-467f-8ee5-95a826be6b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:15.701804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1991-7aed-467f-8ee5-95a826be6b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:15.780485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b1991-7aed-467f-8ee5-95a826be6b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:15.782281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b1991-7aed-467f-8ee5-95a826be6b0b service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:15.793553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1293/2536] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:20.411348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8ba19-78a8-4b30-97f0-99af14beedd7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:20.413292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-47e8ba19-78a8-4b30-97f0-99af14beedd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:20.427307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8ba19-78a8-4b30-97f0-99af14beedd7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:20.431954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a88e5b-bcaa-4262-a5bd-fe4a1c96a5d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:20.432759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a88e5b-bcaa-4262-a5bd-fe4a1c96a5d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:20.433271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a88e5b-bcaa-4262-a5bd-fe4a1c96a5d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:20.433735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a88e5b-bcaa-4262-a5bd-fe4a1c96a5d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:20.445139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a88e5b-bcaa-4262-a5bd-fe4a1c96a5d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:20.446970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a88e5b-bcaa-4262-a5bd-fe4a1c96a5d9 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:20.459420 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1244/2537] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:25.491506 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1991-7aed-467f-8ee5-95a826be6b0b service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:25.595217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1991-7aed-467f-8ee5-95a826be6b0b service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:25.603555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:25.605130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:25.605612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:25.606104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] PATH_INFO: `/v3/users/d2ea2416947547a0bd1a309786b8f1db` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:25.608390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ea2416947547a0bd1a309786b8f1db)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:25.612221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:25.686374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ea2416947547a0bd1a309786b8f1db'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:25.687080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ea2416947547a0bd1a309786b8f1db'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:25.687694 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ea2416947547a0bd1a309786b8f1db'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:25.706443 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ea2416947547a0bd1a309786b8f1db'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:25.718096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ea2416947547a0bd1a309786b8f1db'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:25.729514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:25.738393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1294/2538] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:25 2022] DELETE /identity/v3/users/d2ea2416947547a0bd1a309786b8f1db => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:25.744194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1d9c-5ffc-40d1-bd7c-d96ebde31d26 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:25.744852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1d9c-5ffc-40d1-bd7c-d96ebde31d26 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:25.744852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1d9c-5ffc-40d1-bd7c-d96ebde31d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:25.772210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-206a1d9c-5ffc-40d1-bd7c-d96ebde31d26 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:25.774213 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-206a1d9c-5ffc-40d1-bd7c-d96ebde31d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:25.845472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1245/2539] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:32:25.856222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:25.857684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:25.924453 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22878bf-604d-4b90-8e88-d385210320be admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:25.928534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d531a-d018-411a-8714-fb0f832712ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:25.929224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d531a-d018-411a-8714-fb0f832712ca service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:25.929507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d531a-d018-411a-8714-fb0f832712ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:25.929797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d531a-d018-411a-8714-fb0f832712ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:25.940807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d531a-d018-411a-8714-fb0f832712ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:25.942339 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d531a-d018-411a-8714-fb0f832712ca service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:25.954187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1295/2540] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:32:26.282138 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1d9c-5ffc-40d1-bd7c-d96ebde31d26 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:26.284018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-206a1d9c-5ffc-40d1-bd7c-d96ebde31d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:26.305731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1d9c-5ffc-40d1-bd7c-d96ebde31d26 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:26.310899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:26.311821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:26.312103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:26.312736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] PATH_INFO: `/v3/projects/cb76106da0274ace8b1ac39925675b11` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:26.313963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb76106da0274ace8b1ac39925675b11)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:26.316022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:26.378147 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb76106da0274ace8b1ac39925675b11', 'request_id': 'req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:26.385048 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb76106da0274ace8b1ac39925675b11', 'request_id': 'req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:26.395439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb76106da0274ace8b1ac39925675b11', 'request_id': 'req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:26.411844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] The token cache is being invalidate because project cb76106da0274ace8b1ac39925675b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:26.412300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:26.413174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:26.415168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1246/2541] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:26 2022] DELETE /identity/v3/projects/cb76106da0274ace8b1ac39925675b11 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:26.419822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d531a-d018-411a-8714-fb0f832712ca service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:26.431341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d531a-d018-411a-8714-fb0f832712ca service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:26.503068 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:26.504173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:26.504504 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:26.504824 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] PATH_INFO: `/v3/users/6c5344d99fe8404ba7959a43681b1bb0` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:26.506441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5344d99fe8404ba7959a43681b1bb0)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:26.508619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:26.573804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5344d99fe8404ba7959a43681b1bb0'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:26.574913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5344d99fe8404ba7959a43681b1bb0'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:26.575758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5344d99fe8404ba7959a43681b1bb0'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:26.591701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5344d99fe8404ba7959a43681b1bb0'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:26.601203 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-ed4b0779-dad9-4975-95ee-21ef304a5861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5344d99fe8404ba7959a43681b1bb0'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:26.617933 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1296/2542] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:26 2022] DELETE /identity/v3/users/6c5344d99fe8404ba7959a43681b1bb0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:27.024727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:27.026857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:27.049863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa9e4-c53f-4e4c-bfc3-69528d798f92 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:27.124126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:27.150433 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:27.151352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:27.151760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:27.152039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] PATH_INFO: `/v3/projects/49f48c744fdc4f2b8320bd7796b27f8c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:27.153858 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f48c744fdc4f2b8320bd7796b27f8c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:27.156087 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:27.225681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f48c744fdc4f2b8320bd7796b27f8c', 'request_id': 'req-31df989f-5d90-4274-a208-02bedc0897db'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:27.233457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f48c744fdc4f2b8320bd7796b27f8c', 'request_id': 'req-31df989f-5d90-4274-a208-02bedc0897db'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:27.248451 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f48c744fdc4f2b8320bd7796b27f8c', 'request_id': 'req-31df989f-5d90-4274-a208-02bedc0897db'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:27.264518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] The token cache is being invalidate because project 49f48c744fdc4f2b8320bd7796b27f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:27.264855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:27.265483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-31df989f-5d90-4274-a208-02bedc0897db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:27.267156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1247/2543] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:27 2022] DELETE /identity/v3/projects/49f48c744fdc4f2b8320bd7796b27f8c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:32:27.273696 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cbe9b-dcb7-499b-b147-8ad7f1929f8c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:27.273995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cbe9b-dcb7-499b-b147-8ad7f1929f8c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:27.274360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cbe9b-dcb7-499b-b147-8ad7f1929f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:27.297083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-762cbe9b-dcb7-499b-b147-8ad7f1929f8c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:27.299827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-762cbe9b-dcb7-499b-b147-8ad7f1929f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:27.322756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:27.382799 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1297/2544] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:27.392282 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fbb8-0ac4-4393-b078-d5a0955237d1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:27.392617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fbb8-0ac4-4393-b078-d5a0955237d1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:27.392829 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fbb8-0ac4-4393-b078-d5a0955237d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:27.422422 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3746fbb8-0ac4-4393-b078-d5a0955237d1 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:27.424600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3746fbb8-0ac4-4393-b078-d5a0955237d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:27.436496 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1248/2545] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:27.441520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cbe9b-dcb7-499b-b147-8ad7f1929f8c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:27.452759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cbe9b-dcb7-499b-b147-8ad7f1929f8c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:27.458256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f8d1d-4384-4684-a81e-a6030af16551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:27.458999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f8d1d-4384-4684-a81e-a6030af16551 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:27.459282 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f8d1d-4384-4684-a81e-a6030af16551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:27.459563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f8d1d-4384-4684-a81e-a6030af16551 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:27.460317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f8d1d-4384-4684-a81e-a6030af16551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:32:27.460625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f8d1d-4384-4684-a81e-a6030af16551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:27.462304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f8d1d-4384-4684-a81e-a6030af16551 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:27.477100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1298/2546] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:32:27.482343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746fbb8-0ac4-4393-b078-d5a0955237d1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:27.492564 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746fbb8-0ac4-4393-b078-d5a0955237d1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:27.497776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6d56b-43b0-4938-81a9-41fecf0cdd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:27.498466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6d56b-43b0-4938-81a9-41fecf0cdd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:27.498838 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6d56b-43b0-4938-81a9-41fecf0cdd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:27.499142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6d56b-43b0-4938-81a9-41fecf0cdd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:27.499840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6d56b-43b0-4938-81a9-41fecf0cdd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:27.501836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6d56b-43b0-4938-81a9-41fecf0cdd57 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:27.533420 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1249/2547] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:27 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:32:27.538109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f8d1d-4384-4684-a81e-a6030af16551 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:27.551730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f8d1d-4384-4684-a81e-a6030af16551 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:27.630263 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e46626-4ca0-42fa-b87f-e1e4c48b0b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:27.630992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e46626-4ca0-42fa-b87f-e1e4c48b0b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:27.631273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e46626-4ca0-42fa-b87f-e1e4c48b0b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:27.631546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e46626-4ca0-42fa-b87f-e1e4c48b0b5a admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:27.632297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e46626-4ca0-42fa-b87f-e1e4c48b0b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:27.634732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e46626-4ca0-42fa-b87f-e1e4c48b0b5a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:27.660921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1299/2548] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:27 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:27.666210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6d56b-43b0-4938-81a9-41fecf0cdd57 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:27.682413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6d56b-43b0-4938-81a9-41fecf0cdd57 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:27.688981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cfb0d-5823-445a-a126-51fc47fcc353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:27.689694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cfb0d-5823-445a-a126-51fc47fcc353 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:27.689974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cfb0d-5823-445a-a126-51fc47fcc353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:27.690246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cfb0d-5823-445a-a126-51fc47fcc353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:27.691061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cfb0d-5823-445a-a126-51fc47fcc353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:27.692733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cfb0d-5823-445a-a126-51fc47fcc353 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:27.705378 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1250/2549] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:32:27.709879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e46626-4ca0-42fa-b87f-e1e4c48b0b5a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:27.721134 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e46626-4ca0-42fa-b87f-e1e4c48b0b5a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:27.726461 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fab3f-95cc-4500-af91-f35312e015b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:27.727212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fab3f-95cc-4500-af91-f35312e015b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:27.727499 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fab3f-95cc-4500-af91-f35312e015b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:27.727777 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fab3f-95cc-4500-af91-f35312e015b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:27.728573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fab3f-95cc-4500-af91-f35312e015b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:27.730240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fab3f-95cc-4500-af91-f35312e015b8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:27.743197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1300/2550] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:27.747959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cfb0d-5823-445a-a126-51fc47fcc353 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:27.759203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cfb0d-5823-445a-a126-51fc47fcc353 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:27.766522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9fd84-bd55-4346-9c96-1a79b61aaf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:27.768049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9fd84-bd55-4346-9c96-1a79b61aaf6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:27.768522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9fd84-bd55-4346-9c96-1a79b61aaf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:27.768977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9fd84-bd55-4346-9c96-1a79b61aaf6e admin admin] PATH_INFO: `/v3/projects/b0b1f58598144af3a38c3b8fe949cbef/users/7d9b4b45c92740e0bc004ed990ebc33a/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:27.797331 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9fd84-bd55-4346-9c96-1a79b61aaf6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b1f58598144af3a38c3b8fe949cbef, user_id=7d9b4b45c92740e0bc004ed990ebc33a, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:27.803073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9fd84-bd55-4346-9c96-1a79b61aaf6e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:27.827565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1251/2551] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:27 2022] PUT /identity/v3/projects/b0b1f58598144af3a38c3b8fe949cbef/users/7d9b4b45c92740e0bc004ed990ebc33a/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:27.840990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3c4b1-3bc0-453c-80f9-0d3a90009acc None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:27.841302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3c4b1-3bc0-453c-80f9-0d3a90009acc None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:27.841588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3c4b1-3bc0-453c-80f9-0d3a90009acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:27.876401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-86e3c4b1-3bc0-453c-80f9-0d3a90009acc None None] MFA Rules not processed for user `7d9b4b45c92740e0bc004ed990ebc33a`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:27.877682 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-86e3c4b1-3bc0-453c-80f9-0d3a90009acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:27.957384 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1301/2552] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:27.962760 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9fd84-bd55-4346-9c96-1a79b61aaf6e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:28.054599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9fd84-bd55-4346-9c96-1a79b61aaf6e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:28.060086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b05a9-ef14-469a-8629-d9ae83ed6326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:28.060831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b05a9-ef14-469a-8629-d9ae83ed6326 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:28.061244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b05a9-ef14-469a-8629-d9ae83ed6326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:28.061562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b05a9-ef14-469a-8629-d9ae83ed6326 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:28.062369 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b05a9-ef14-469a-8629-d9ae83ed6326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:28.064649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b05a9-ef14-469a-8629-d9ae83ed6326 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:28.076930 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:28.108523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1252/2553] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:27 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:28.113056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3c4b1-3bc0-453c-80f9-0d3a90009acc None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:28.125641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3c4b1-3bc0-453c-80f9-0d3a90009acc None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:28.140274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:28.204926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e33acc-a6eb-4fb6-bd1b-6545a8dc2c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:28.205624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e33acc-a6eb-4fb6-bd1b-6545a8dc2c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:28.205910 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e33acc-a6eb-4fb6-bd1b-6545a8dc2c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:28.206186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e33acc-a6eb-4fb6-bd1b-6545a8dc2c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:28.206928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e33acc-a6eb-4fb6-bd1b-6545a8dc2c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:28.209013 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e33acc-a6eb-4fb6-bd1b-6545a8dc2c0f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:28.234554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1302/2554] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:28 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:32:28.240204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b05a9-ef14-469a-8629-d9ae83ed6326 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:28.254723 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b05a9-ef14-469a-8629-d9ae83ed6326 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:28.260125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e8947-faf5-42ab-978c-2a7f8362b6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:28.260873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e8947-faf5-42ab-978c-2a7f8362b6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:28.261209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e8947-faf5-42ab-978c-2a7f8362b6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:28.261533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e8947-faf5-42ab-978c-2a7f8362b6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:28.262413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e8947-faf5-42ab-978c-2a7f8362b6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:28.264311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e8947-faf5-42ab-978c-2a7f8362b6d3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:28.276729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1253/2555] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:32:28.283094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e33acc-a6eb-4fb6-bd1b-6545a8dc2c0f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:28.301711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e33acc-a6eb-4fb6-bd1b-6545a8dc2c0f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:28.310039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1cb9e-b9ca-48af-b6f8-47a6b2ca3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:28.311692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1cb9e-b9ca-48af-b6f8-47a6b2ca3a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:28.312172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1cb9e-b9ca-48af-b6f8-47a6b2ca3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:28.312654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1cb9e-b9ca-48af-b6f8-47a6b2ca3a4b admin admin] PATH_INFO: `/v3/projects/06b86db80b6d4407bbbd919e96f7361b/users/ee6dd6a86fdc4458adad302ffaab1fd7/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:28.333690 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1cb9e-b9ca-48af-b6f8-47a6b2ca3a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b86db80b6d4407bbbd919e96f7361b, user_id=ee6dd6a86fdc4458adad302ffaab1fd7, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:28.336742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1cb9e-b9ca-48af-b6f8-47a6b2ca3a4b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:28.355027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1303/2556] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:28 2022] PUT /identity/v3/projects/06b86db80b6d4407bbbd919e96f7361b/users/ee6dd6a86fdc4458adad302ffaab1fd7/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:28.360451 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e8947-faf5-42ab-978c-2a7f8362b6d3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:28.372465 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e8947-faf5-42ab-978c-2a7f8362b6d3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:28.442970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b4038-64ba-4c98-8b9c-dc2b66abcac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:28.443636 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b4038-64ba-4c98-8b9c-dc2b66abcac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:28.443931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b4038-64ba-4c98-8b9c-dc2b66abcac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:28.444208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b4038-64ba-4c98-8b9c-dc2b66abcac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:28.444949 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b4038-64ba-4c98-8b9c-dc2b66abcac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:28.446607 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b4038-64ba-4c98-8b9c-dc2b66abcac8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:28.458958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1254/2557] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:28.463944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1cb9e-b9ca-48af-b6f8-47a6b2ca3a4b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:28.475713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1cb9e-b9ca-48af-b6f8-47a6b2ca3a4b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:28.480994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395ac99-9e55-4dc7-abc4-a43535ae0c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:28.481928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395ac99-9e55-4dc7-abc4-a43535ae0c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:28.482215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395ac99-9e55-4dc7-abc4-a43535ae0c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:28.482492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395ac99-9e55-4dc7-abc4-a43535ae0c5f admin admin] PATH_INFO: `/v3/projects/06b86db80b6d4407bbbd919e96f7361b/users/ee6dd6a86fdc4458adad302ffaab1fd7/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:28.484838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395ac99-9e55-4dc7-abc4-a43535ae0c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b86db80b6d4407bbbd919e96f7361b, user_id=ee6dd6a86fdc4458adad302ffaab1fd7, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:28.487752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395ac99-9e55-4dc7-abc4-a43535ae0c5f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:28.501036 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1304/2558] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:28 2022] PUT /identity/v3/projects/06b86db80b6d4407bbbd919e96f7361b/users/ee6dd6a86fdc4458adad302ffaab1fd7/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:32:28.512889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19259ce8-7fc2-4a40-95ad-43d5a533d7f1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:28.513159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19259ce8-7fc2-4a40-95ad-43d5a533d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:28.513434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19259ce8-7fc2-4a40-95ad-43d5a533d7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:28.547483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-19259ce8-7fc2-4a40-95ad-43d5a533d7f1 None None] MFA Rules not processed for user `ee6dd6a86fdc4458adad302ffaab1fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:28.548749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-19259ce8-7fc2-4a40-95ad-43d5a533d7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:28.630336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1255/2559] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:28.643729 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395ac99-9e55-4dc7-abc4-a43535ae0c5f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:28.647835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9395ac99-9e55-4dc7-abc4-a43535ae0c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:28.719843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395ac99-9e55-4dc7-abc4-a43535ae0c5f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:28.723839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c359ca4-c090-4eee-844d-2ec4fd6223c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:28.724568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c359ca4-c090-4eee-844d-2ec4fd6223c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:28.724984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c359ca4-c090-4eee-844d-2ec4fd6223c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:28.725327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c359ca4-c090-4eee-844d-2ec4fd6223c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:28.794306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c359ca4-c090-4eee-844d-2ec4fd6223c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:28.796594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c359ca4-c090-4eee-844d-2ec4fd6223c9 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:28.807553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1305/2560] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:31.577365 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19259ce8-7fc2-4a40-95ad-43d5a533d7f1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:31.672236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19259ce8-7fc2-4a40-95ad-43d5a533d7f1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:31.677170 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:31.678115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:31.678425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:31.678740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] PATH_INFO: `/v3/users/7d9b4b45c92740e0bc004ed990ebc33a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:31.680078 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9b4b45c92740e0bc004ed990ebc33a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:31.682101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:31.685279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:31.753301 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9b4b45c92740e0bc004ed990ebc33a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:31.763903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9b4b45c92740e0bc004ed990ebc33a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:31.764734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9b4b45c92740e0bc004ed990ebc33a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:31.783708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9b4b45c92740e0bc004ed990ebc33a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:31.795493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9b4b45c92740e0bc004ed990ebc33a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:31.804673 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1256/2561] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:31 2022] DELETE /identity/v3/users/7d9b4b45c92740e0bc004ed990ebc33a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:31.809465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e287dc-3721-4a8b-93e0-bb64cfec5d72 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:31.810121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e287dc-3721-4a8b-93e0-bb64cfec5d72 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:31.810121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e287dc-3721-4a8b-93e0-bb64cfec5d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:31.829537 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-48e287dc-3721-4a8b-93e0-bb64cfec5d72 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:31.830826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-48e287dc-3721-4a8b-93e0-bb64cfec5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:31.851197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:31.904514 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1306/2562] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:31.915451 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:31.917031 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:31.992275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcbd85-9326-4d6d-820d-a8eb9bc1ce8c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:31.996420 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a024-9681-4666-b126-28d0fcf8ac41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:31.997091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a024-9681-4666-b126-28d0fcf8ac41 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:31.997376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a024-9681-4666-b126-28d0fcf8ac41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:31.997652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a024-9681-4666-b126-28d0fcf8ac41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:32.008921 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266a024-9681-4666-b126-28d0fcf8ac41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:32.010487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266a024-9681-4666-b126-28d0fcf8ac41 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:32.022715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1257/2563] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:32.358702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e287dc-3721-4a8b-93e0-bb64cfec5d72 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:32.364559 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-48e287dc-3721-4a8b-93e0-bb64cfec5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:32.387372 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e287dc-3721-4a8b-93e0-bb64cfec5d72 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:32.394285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:32.395287 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:32.395512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:32.395793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] PATH_INFO: `/v3/projects/b0b1f58598144af3a38c3b8fe949cbef` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:32.397471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b1f58598144af3a38c3b8fe949cbef)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:32.399808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:32.461615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b1f58598144af3a38c3b8fe949cbef', 'request_id': 'req-a8fc98a6-81c1-4f10-b163-5d254e349464'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:32.471818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b1f58598144af3a38c3b8fe949cbef', 'request_id': 'req-a8fc98a6-81c1-4f10-b163-5d254e349464'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:32.481264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b1f58598144af3a38c3b8fe949cbef', 'request_id': 'req-a8fc98a6-81c1-4f10-b163-5d254e349464'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:32.494915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] The token cache is being invalidate because project b0b1f58598144af3a38c3b8fe949cbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:32.495378 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:32.496379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:32.499134 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1307/2564] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:32 2022] DELETE /identity/v3/projects/b0b1f58598144af3a38c3b8fe949cbef => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:32.505571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a024-9681-4666-b126-28d0fcf8ac41 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:32.523103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a024-9681-4666-b126-28d0fcf8ac41 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:32.607659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:32.609308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:32.609803 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:32.610289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] PATH_INFO: `/v3/users/ee6dd6a86fdc4458adad302ffaab1fd7` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:32.612509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6dd6a86fdc4458adad302ffaab1fd7)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:32.616264 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:32.658991 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:32.686809 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6dd6a86fdc4458adad302ffaab1fd7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:32.696747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6dd6a86fdc4458adad302ffaab1fd7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:32.697531 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6dd6a86fdc4458adad302ffaab1fd7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:32.712575 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6dd6a86fdc4458adad302ffaab1fd7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:32.721513 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9072790e-afc8-4527-a4f3-13cabb426e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6dd6a86fdc4458adad302ffaab1fd7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:32.729052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1258/2565] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:32 2022] DELETE /identity/v3/users/ee6dd6a86fdc4458adad302ffaab1fd7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:33.124245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:33.126001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:33.140187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc98a6-81c1-4f10-b163-5d254e349464 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:33.244520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:33.246047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:33.246490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:33.247004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] PATH_INFO: `/v3/projects/06b86db80b6d4407bbbd919e96f7361b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:33.249086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b86db80b6d4407bbbd919e96f7361b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:33.251233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:33.310109 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:33.312074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b86db80b6d4407bbbd919e96f7361b', 'request_id': 'req-23390cb3-d3db-497d-83fa-f52ebd2af0d4'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:33.323163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b86db80b6d4407bbbd919e96f7361b', 'request_id': 'req-23390cb3-d3db-497d-83fa-f52ebd2af0d4'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:33.331143 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b86db80b6d4407bbbd919e96f7361b', 'request_id': 'req-23390cb3-d3db-497d-83fa-f52ebd2af0d4'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:33.343665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] The token cache is being invalidate because project 06b86db80b6d4407bbbd919e96f7361b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:33.344049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:33.344625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-23390cb3-d3db-497d-83fa-f52ebd2af0d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:33.346261 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1308/2566] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:33 2022] DELETE /identity/v3/projects/06b86db80b6d4407bbbd919e96f7361b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:33.352084 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd6ca-bb7a-4552-8b06-bed9589c0195 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:33.352410 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd6ca-bb7a-4552-8b06-bed9589c0195 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:33.352815 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd6ca-bb7a-4552-8b06-bed9589c0195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:33.374435 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0aecd6ca-bb7a-4552-8b06-bed9589c0195 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:33.375743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0aecd6ca-bb7a-4552-8b06-bed9589c0195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:33.448412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1259/2567] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:33.457356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b462db-06a2-4b19-847d-f40e6d4051b4 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:33.457812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b462db-06a2-4b19-847d-f40e6d4051b4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:33.458217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b462db-06a2-4b19-847d-f40e6d4051b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:33.480321 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-91b462db-06a2-4b19-847d-f40e6d4051b4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:33.481561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-91b462db-06a2-4b19-847d-f40e6d4051b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:33.491313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1309/2568] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:33.496426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecd6ca-bb7a-4552-8b06-bed9589c0195 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:33.511134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecd6ca-bb7a-4552-8b06-bed9589c0195 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:33.517096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e01d5-a973-44ac-b24c-4219a139c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:33.517948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e01d5-a973-44ac-b24c-4219a139c5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:33.518330 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e01d5-a973-44ac-b24c-4219a139c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:33.518732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e01d5-a973-44ac-b24c-4219a139c5dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:33.519675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e01d5-a973-44ac-b24c-4219a139c5dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:32:33.520082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e01d5-a973-44ac-b24c-4219a139c5dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:33.522221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e01d5-a973-44ac-b24c-4219a139c5dc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:33.545983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1260/2569] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:32:33.550454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b462db-06a2-4b19-847d-f40e6d4051b4 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:33.560724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b462db-06a2-4b19-847d-f40e6d4051b4 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:33.566861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0525dff-38a6-4bff-9ced-071bfb05e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:33.567617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0525dff-38a6-4bff-9ced-071bfb05e1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:33.567939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0525dff-38a6-4bff-9ced-071bfb05e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:33.568250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0525dff-38a6-4bff-9ced-071bfb05e1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:33.569025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0525dff-38a6-4bff-9ced-071bfb05e1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:33.571152 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0525dff-38a6-4bff-9ced-071bfb05e1d6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:33.603296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1310/2570] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:33 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:32:33.608068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e01d5-a973-44ac-b24c-4219a139c5dc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:33.620585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e01d5-a973-44ac-b24c-4219a139c5dc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:33.690314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ccfce-95e8-4cef-8a3f-2fb0a3856e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:33.691044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ccfce-95e8-4cef-8a3f-2fb0a3856e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:33.691324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ccfce-95e8-4cef-8a3f-2fb0a3856e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:33.691596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ccfce-95e8-4cef-8a3f-2fb0a3856e74 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:33.692367 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ccfce-95e8-4cef-8a3f-2fb0a3856e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:33.694419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ccfce-95e8-4cef-8a3f-2fb0a3856e74 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:33.720552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1261/2571] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:33 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:33.725115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0525dff-38a6-4bff-9ced-071bfb05e1d6 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:33.739010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0525dff-38a6-4bff-9ced-071bfb05e1d6 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:33.744955 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61d8e-3af5-4a37-9a76-c74e40ef8b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:33.745672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61d8e-3af5-4a37-9a76-c74e40ef8b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:33.745961 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61d8e-3af5-4a37-9a76-c74e40ef8b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:33.746234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61d8e-3af5-4a37-9a76-c74e40ef8b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:33.747040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd61d8e-3af5-4a37-9a76-c74e40ef8b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:33.750663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd61d8e-3af5-4a37-9a76-c74e40ef8b0f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:33.763669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1311/2572] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:33.769288 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ccfce-95e8-4cef-8a3f-2fb0a3856e74 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:33.788336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ccfce-95e8-4cef-8a3f-2fb0a3856e74 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:33.796719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb85a0-24f1-4ad3-b53e-8743416f3809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:33.797873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb85a0-24f1-4ad3-b53e-8743416f3809 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:33.798375 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb85a0-24f1-4ad3-b53e-8743416f3809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:33.798909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb85a0-24f1-4ad3-b53e-8743416f3809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:33.800385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb85a0-24f1-4ad3-b53e-8743416f3809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:33.803794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb85a0-24f1-4ad3-b53e-8743416f3809 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:33.824328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1262/2573] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:33.829572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61d8e-3af5-4a37-9a76-c74e40ef8b0f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:33.844240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61d8e-3af5-4a37-9a76-c74e40ef8b0f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:33.851939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7929bf-d997-425f-81f6-d283664beece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:33.853507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7929bf-d997-425f-81f6-d283664beece admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:33.853995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7929bf-d997-425f-81f6-d283664beece admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:33.854525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7929bf-d997-425f-81f6-d283664beece admin admin] PATH_INFO: `/v3/projects/42a7783019d54751ba41c0db80540314/users/f1b7ff90fc4d4b4f8a25c4c6e881228c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:33.883673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7929bf-d997-425f-81f6-d283664beece admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a7783019d54751ba41c0db80540314, user_id=f1b7ff90fc4d4b4f8a25c4c6e881228c, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:33.888976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7929bf-d997-425f-81f6-d283664beece admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:33.910100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1312/2574] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:33 2022] PUT /identity/v3/projects/42a7783019d54751ba41c0db80540314/users/f1b7ff90fc4d4b4f8a25c4c6e881228c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:32:33.922183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291942f-3779-4cb3-99a1-b6bf46142152 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:33.922530 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291942f-3779-4cb3-99a1-b6bf46142152 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:33.922928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291942f-3779-4cb3-99a1-b6bf46142152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:33.944458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:33.958649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f291942f-3779-4cb3-99a1-b6bf46142152 None None] MFA Rules not processed for user `f1b7ff90fc4d4b4f8a25c4c6e881228c`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:33.960916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f291942f-3779-4cb3-99a1-b6bf46142152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:34.042377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1263/2575] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:32:34.047476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7929bf-d997-425f-81f6-d283664beece admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:34.154395 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7929bf-d997-425f-81f6-d283664beece admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:34.161217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129fd34-b213-40e3-b7ae-42b504f8a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:34.161927 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129fd34-b213-40e3-b7ae-42b504f8a856 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:34.162248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129fd34-b213-40e3-b7ae-42b504f8a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:34.162693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129fd34-b213-40e3-b7ae-42b504f8a856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:34.163303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129fd34-b213-40e3-b7ae-42b504f8a856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:34.165399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129fd34-b213-40e3-b7ae-42b504f8a856 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:34.199105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1313/2576] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:34 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:34.203876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291942f-3779-4cb3-99a1-b6bf46142152 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:34.215961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291942f-3779-4cb3-99a1-b6bf46142152 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:34.317310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54795f6-7386-462c-894d-541d44989adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:34.318364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54795f6-7386-462c-894d-541d44989adb admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:34.318861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54795f6-7386-462c-894d-541d44989adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:34.319368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54795f6-7386-462c-894d-541d44989adb admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:34.320703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54795f6-7386-462c-894d-541d44989adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:34.324913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54795f6-7386-462c-894d-541d44989adb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:34.355439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1264/2577] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:34 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:32:34.360054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129fd34-b213-40e3-b7ae-42b504f8a856 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:34.371969 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129fd34-b213-40e3-b7ae-42b504f8a856 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:34.377346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901ca11-a6a3-4804-8a79-e26f9b5741e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:34.378214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ca11-a6a3-4804-8a79-e26f9b5741e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:34.378526 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ca11-a6a3-4804-8a79-e26f9b5741e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:34.378816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ca11-a6a3-4804-8a79-e26f9b5741e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:34.379568 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901ca11-a6a3-4804-8a79-e26f9b5741e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:34.381233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901ca11-a6a3-4804-8a79-e26f9b5741e3 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:34.393665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1314/2578] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:34.398813 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54795f6-7386-462c-894d-541d44989adb admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:34.412074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54795f6-7386-462c-894d-541d44989adb admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:34.418129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494412f-45e6-4db3-9db0-57a984492e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:34.418876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494412f-45e6-4db3-9db0-57a984492e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:34.419157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494412f-45e6-4db3-9db0-57a984492e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:34.419428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494412f-45e6-4db3-9db0-57a984492e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:34.420171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494412f-45e6-4db3-9db0-57a984492e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:34.421877 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494412f-45e6-4db3-9db0-57a984492e52 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:34.434203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1265/2579] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:34.438805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901ca11-a6a3-4804-8a79-e26f9b5741e3 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:34.450262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901ca11-a6a3-4804-8a79-e26f9b5741e3 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:34.456020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f964721-f2ef-44a7-a0b8-0f1bddb9d5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:34.456952 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f964721-f2ef-44a7-a0b8-0f1bddb9d5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:34.457238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f964721-f2ef-44a7-a0b8-0f1bddb9d5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:34.457517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f964721-f2ef-44a7-a0b8-0f1bddb9d5ca admin admin] PATH_INFO: `/v3/projects/62fe09086f404b6399e222b70af2f826/users/8f06568cebfe4ff88c80286fb5204e8a/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:34.476190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f964721-f2ef-44a7-a0b8-0f1bddb9d5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fe09086f404b6399e222b70af2f826, user_id=8f06568cebfe4ff88c80286fb5204e8a, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:34.479001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f964721-f2ef-44a7-a0b8-0f1bddb9d5ca admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:34.496019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1315/2580] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:34 2022] PUT /identity/v3/projects/62fe09086f404b6399e222b70af2f826/users/8f06568cebfe4ff88c80286fb5204e8a/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:32:34.508947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fba15d-5010-4632-98e7-dfd4d54d1482 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:34.509424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fba15d-5010-4632-98e7-dfd4d54d1482 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:34.509859 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fba15d-5010-4632-98e7-dfd4d54d1482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:34.552650 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-72fba15d-5010-4632-98e7-dfd4d54d1482 None None] MFA Rules not processed for user `8f06568cebfe4ff88c80286fb5204e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:34.553872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-72fba15d-5010-4632-98e7-dfd4d54d1482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:34.634103 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1266/2581] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:34.639074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f964721-f2ef-44a7-a0b8-0f1bddb9d5ca admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:34.668612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:34.717315 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f964721-f2ef-44a7-a0b8-0f1bddb9d5ca admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:34.723439 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdc35e-c662-4702-a2c3-a017fdb2f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:34.724143 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdc35e-c662-4702-a2c3-a017fdb2f55b admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:34.724422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdc35e-c662-4702-a2c3-a017fdb2f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:34.724742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdc35e-c662-4702-a2c3-a017fdb2f55b admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:34.725634 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdc35e-c662-4702-a2c3-a017fdb2f55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:34.727687 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdc35e-c662-4702-a2c3-a017fdb2f55b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:34.759900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1316/2582] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:34 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:32:34.765059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fba15d-5010-4632-98e7-dfd4d54d1482 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:34.779300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fba15d-5010-4632-98e7-dfd4d54d1482 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:34.785906 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:34.875027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdd79d-9a23-4312-b5b7-e903e21957d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:34.876193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdd79d-9a23-4312-b5b7-e903e21957d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:34.876689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdd79d-9a23-4312-b5b7-e903e21957d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:34.877144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdd79d-9a23-4312-b5b7-e903e21957d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:34.878307 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdd79d-9a23-4312-b5b7-e903e21957d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:34.881942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdd79d-9a23-4312-b5b7-e903e21957d9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:34.916764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1267/2583] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:34 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:32:34.921343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdc35e-c662-4702-a2c3-a017fdb2f55b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:34.934066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdc35e-c662-4702-a2c3-a017fdb2f55b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:34.940075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761926-46a6-4224-bddc-6080e028a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:34.940793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761926-46a6-4224-bddc-6080e028a3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:34.941080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761926-46a6-4224-bddc-6080e028a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:34.941357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761926-46a6-4224-bddc-6080e028a3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:34.942126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67761926-46a6-4224-bddc-6080e028a3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:34.943870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67761926-46a6-4224-bddc-6080e028a3b4 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:34.957773 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1317/2584] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:34.963106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdd79d-9a23-4312-b5b7-e903e21957d9 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:34.981597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdd79d-9a23-4312-b5b7-e903e21957d9 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:34.989721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b3a7a-fc1b-4a9e-8ae7-446ba0ad88da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:34.991187 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3a7a-fc1b-4a9e-8ae7-446ba0ad88da admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:34.991646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3a7a-fc1b-4a9e-8ae7-446ba0ad88da admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:34.992101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3a7a-fc1b-4a9e-8ae7-446ba0ad88da admin admin] PATH_INFO: `/v3/projects/efd2b585d74843d19faa7ac4821aa298/users/80feb78547af4fd5aca5335721093876/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:35.028639 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b3a7a-fc1b-4a9e-8ae7-446ba0ad88da admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd2b585d74843d19faa7ac4821aa298, user_id=80feb78547af4fd5aca5335721093876, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:35.033894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b3a7a-fc1b-4a9e-8ae7-446ba0ad88da admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:35.052646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1268/2585] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:34 2022] PUT /identity/v3/projects/efd2b585d74843d19faa7ac4821aa298/users/80feb78547af4fd5aca5335721093876/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:35.058706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761926-46a6-4224-bddc-6080e028a3b4 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:35.070790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761926-46a6-4224-bddc-6080e028a3b4 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:35.142206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2494c4-2fee-4a36-b937-74244905ab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:35.142876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2494c4-2fee-4a36-b937-74244905ab44 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:35.143162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2494c4-2fee-4a36-b937-74244905ab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:35.143440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2494c4-2fee-4a36-b937-74244905ab44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:35.144196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2494c4-2fee-4a36-b937-74244905ab44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:35.145914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2494c4-2fee-4a36-b937-74244905ab44 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:35.159815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1318/2586] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:35.163831 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b3a7a-fc1b-4a9e-8ae7-446ba0ad88da admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:35.176160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b3a7a-fc1b-4a9e-8ae7-446ba0ad88da admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:35.182803 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51e7ee-5ab8-41a3-abdd-9a1dddb1b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:35.184305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e7ee-5ab8-41a3-abdd-9a1dddb1b788 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:35.184746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e7ee-5ab8-41a3-abdd-9a1dddb1b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:35.185199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e7ee-5ab8-41a3-abdd-9a1dddb1b788 admin admin] PATH_INFO: `/v3/projects/efd2b585d74843d19faa7ac4821aa298/users/80feb78547af4fd5aca5335721093876/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:35.195417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51e7ee-5ab8-41a3-abdd-9a1dddb1b788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd2b585d74843d19faa7ac4821aa298, user_id=80feb78547af4fd5aca5335721093876, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:35.200576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51e7ee-5ab8-41a3-abdd-9a1dddb1b788 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:35.214270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1269/2587] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:35 2022] PUT /identity/v3/projects/efd2b585d74843d19faa7ac4821aa298/users/80feb78547af4fd5aca5335721093876/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:35.225173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420c2b-c0f4-40a9-9321-9a677c951191 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:35.225596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420c2b-c0f4-40a9-9321-9a677c951191 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:35.225994 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420c2b-c0f4-40a9-9321-9a677c951191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:35.259846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-98420c2b-c0f4-40a9-9321-9a677c951191 None None] MFA Rules not processed for user `80feb78547af4fd5aca5335721093876`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:35.261179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-98420c2b-c0f4-40a9-9321-9a677c951191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:35.352369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1319/2588] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:35.366152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51e7ee-5ab8-41a3-abdd-9a1dddb1b788 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:35.368320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fc51e7ee-5ab8-41a3-abdd-9a1dddb1b788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:35.465925 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51e7ee-5ab8-41a3-abdd-9a1dddb1b788 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:35.473432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94380bd-69b3-4590-8ca5-4947e2c2856b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:35.474644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94380bd-69b3-4590-8ca5-4947e2c2856b service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:35.475116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94380bd-69b3-4590-8ca5-4947e2c2856b service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:35.475593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94380bd-69b3-4590-8ca5-4947e2c2856b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:35.577441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94380bd-69b3-4590-8ca5-4947e2c2856b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:35.578979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94380bd-69b3-4590-8ca5-4947e2c2856b service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:35.590008 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1270/2589] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:32:37.178546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98420c2b-c0f4-40a9-9321-9a677c951191 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:37.190791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98420c2b-c0f4-40a9-9321-9a677c951191 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:37.196223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73270afb-9af0-48ce-96b0-2375d7159fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:37.197234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73270afb-9af0-48ce-96b0-2375d7159fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:37.197478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73270afb-9af0-48ce-96b0-2375d7159fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:37.197852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73270afb-9af0-48ce-96b0-2375d7159fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:37.215356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:37.275224 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73270afb-9af0-48ce-96b0-2375d7159fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:37.276791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73270afb-9af0-48ce-96b0-2375d7159fe4 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:37.288375 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1320/2590] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:38.000466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94380bd-69b3-4590-8ca5-4947e2c2856b service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:38.011416 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94380bd-69b3-4590-8ca5-4947e2c2856b service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:38.015722 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bc980-4851-4d56-b67c-2ae0db425e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:38.016394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc980-4851-4d56-b67c-2ae0db425e8b service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:38.016680 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc980-4851-4d56-b67c-2ae0db425e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:38.016956 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc980-4851-4d56-b67c-2ae0db425e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:38.030390 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bc980-4851-4d56-b67c-2ae0db425e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:38.031913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bc980-4851-4d56-b67c-2ae0db425e8b service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:38.038121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:38.044588 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1271/2591] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:32:42.239874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73270afb-9af0-48ce-96b0-2375d7159fe4 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:42.339103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73270afb-9af0-48ce-96b0-2375d7159fe4 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:42.347079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:42.348663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:42.349185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:42.350642 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] PATH_INFO: `/v3/users/f1b7ff90fc4d4b4f8a25c4c6e881228c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:42.352962 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b7ff90fc4d4b4f8a25c4c6e881228c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:42.356984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:42.436067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b7ff90fc4d4b4f8a25c4c6e881228c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:42.437635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b7ff90fc4d4b4f8a25c4c6e881228c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:42.438441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b7ff90fc4d4b4f8a25c4c6e881228c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:42.459070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b7ff90fc4d4b4f8a25c4c6e881228c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:42.473935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b7ff90fc4d4b4f8a25c4c6e881228c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:42.490543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1321/2592] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:42 2022] DELETE /identity/v3/users/f1b7ff90fc4d4b4f8a25c4c6e881228c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:42.496523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66807-0303-4bed-b98e-7e45e98a4272 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:42.497376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66807-0303-4bed-b98e-7e45e98a4272 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:42.497542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66807-0303-4bed-b98e-7e45e98a4272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:42.520722 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-23c66807-0303-4bed-b98e-7e45e98a4272 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:42.522018 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-23c66807-0303-4bed-b98e-7e45e98a4272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:42.608896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1272/2593] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:42.622666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:42.625081 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:42.688487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:42.717142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff50f-64e9-476e-be3e-696b8876076d admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:42.721306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e7bd-efc9-4e00-b2ce-7b6109c80fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:42.721999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e7bd-efc9-4e00-b2ce-7b6109c80fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:42.722282 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e7bd-efc9-4e00-b2ce-7b6109c80fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:42.722602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e7bd-efc9-4e00-b2ce-7b6109c80fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:42.733570 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4e7bd-efc9-4e00-b2ce-7b6109c80fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:42.735288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4e7bd-efc9-4e00-b2ce-7b6109c80fe9 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:42.747303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1322/2594] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:43.109866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66807-0303-4bed-b98e-7e45e98a4272 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:43.112493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-23c66807-0303-4bed-b98e-7e45e98a4272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:43.139948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66807-0303-4bed-b98e-7e45e98a4272 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:43.148788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:43.150304 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:43.150797 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:43.151274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] PATH_INFO: `/v3/projects/42a7783019d54751ba41c0db80540314` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:43.155543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a7783019d54751ba41c0db80540314)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:43.160005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:43.230851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a7783019d54751ba41c0db80540314', 'request_id': 'req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:43.238278 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a7783019d54751ba41c0db80540314', 'request_id': 'req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:43.250490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a7783019d54751ba41c0db80540314', 'request_id': 'req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:43.265076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] The token cache is being invalidate because project 42a7783019d54751ba41c0db80540314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:43.265521 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:43.266270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:43.267959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1273/2595] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:43 2022] DELETE /identity/v3/projects/42a7783019d54751ba41c0db80540314 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:43.273108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e7bd-efc9-4e00-b2ce-7b6109c80fe9 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:43.287096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e7bd-efc9-4e00-b2ce-7b6109c80fe9 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:43.373881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:43.374926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:43.375228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:43.375507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] PATH_INFO: `/v3/users/8f06568cebfe4ff88c80286fb5204e8a` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:43.376916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f06568cebfe4ff88c80286fb5204e8a)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:43.381830 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:43.465870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f06568cebfe4ff88c80286fb5204e8a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:43.466767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f06568cebfe4ff88c80286fb5204e8a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:43.467487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f06568cebfe4ff88c80286fb5204e8a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:43.487719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f06568cebfe4ff88c80286fb5204e8a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:43.498345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f06568cebfe4ff88c80286fb5204e8a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:43.513753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1323/2596] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:43 2022] DELETE /identity/v3/users/8f06568cebfe4ff88c80286fb5204e8a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:44.024475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:44.026545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:44.163086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:44.164747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:44.260824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fd6b-fc43-446a-a800-1a1c9a739ef8 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:44.280717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:44.286878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c403-a02b-4a57-a720-502073f48218 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:44.295507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:44.298663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:44.299914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:44.300282 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:44.300627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] PATH_INFO: `/v3/projects/62fe09086f404b6399e222b70af2f826` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:44.302461 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62fe09086f404b6399e222b70af2f826)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:44.305039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:44.364719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62fe09086f404b6399e222b70af2f826', 'request_id': 'req-3db2a398-c86e-4729-8f77-889f306dd077'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:44.371823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee01c-ada2-4e90-bf97-f343eac637ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:44.373605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee01c-ada2-4e90-bf97-f343eac637ba service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:44.373605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee01c-ada2-4e90-bf97-f343eac637ba service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:44.374152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee01c-ada2-4e90-bf97-f343eac637ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:44.376875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8a5ee01c-ada2-4e90-bf97-f343eac637ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:44.377749 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62fe09086f404b6399e222b70af2f826', 'request_id': 'req-3db2a398-c86e-4729-8f77-889f306dd077'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:44.386360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62fe09086f404b6399e222b70af2f826', 'request_id': 'req-3db2a398-c86e-4729-8f77-889f306dd077'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:44.392667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ee01c-ada2-4e90-bf97-f343eac637ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:44.394328 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ee01c-ada2-4e90-bf97-f343eac637ba service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:44.405476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] The token cache is being invalidate because project 62fe09086f404b6399e222b70af2f826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:44.405787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:44.406880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:44.407696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1274/2597] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:44.412133 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1324/2598] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:44 2022] DELETE /identity/v3/projects/62fe09086f404b6399e222b70af2f826 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:44.413866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee01c-ada2-4e90-bf97-f343eac637ba service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:44.427100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee01c-ada2-4e90-bf97-f343eac637ba service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:44.520320 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:44.521579 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:44.522024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:44.522453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] PATH_INFO: `/v3/users/80feb78547af4fd5aca5335721093876` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:44.524517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80feb78547af4fd5aca5335721093876)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:44.526783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:44.601193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80feb78547af4fd5aca5335721093876'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:44.613236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80feb78547af4fd5aca5335721093876'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:44.614231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80feb78547af4fd5aca5335721093876'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:44.634429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80feb78547af4fd5aca5335721093876'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:44.646199 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-aab67fb3-385d-46dd-9d92-4cc66147c87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80feb78547af4fd5aca5335721093876'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:44.661538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1275/2599] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:44 2022] DELETE /identity/v3/users/80feb78547af4fd5aca5335721093876 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:32:45.104655 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:45.107437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:45.131546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2a398-c86e-4729-8f77-889f306dd077 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:45.234250 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:45.235283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:45.235711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:45.236135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] PATH_INFO: `/v3/projects/efd2b585d74843d19faa7ac4821aa298` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:45.238072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd2b585d74843d19faa7ac4821aa298)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:45.240453 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:45.310441 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd2b585d74843d19faa7ac4821aa298', 'request_id': 'req-54f43fd7-65bb-41bd-8e04-a232ef63567b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:45.321395 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd2b585d74843d19faa7ac4821aa298', 'request_id': 'req-54f43fd7-65bb-41bd-8e04-a232ef63567b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:45.335495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd2b585d74843d19faa7ac4821aa298', 'request_id': 'req-54f43fd7-65bb-41bd-8e04-a232ef63567b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:45.362305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] The token cache is being invalidate because project efd2b585d74843d19faa7ac4821aa298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:45.362784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:45.363672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-54f43fd7-65bb-41bd-8e04-a232ef63567b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:45.365479 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1325/2600] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:45 2022] DELETE /identity/v3/projects/efd2b585d74843d19faa7ac4821aa298 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:32:45.373012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda2917-e5ad-4ff4-af37-762895e28bc5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:45.373792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda2917-e5ad-4ff4-af37-762895e28bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:45.374721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda2917-e5ad-4ff4-af37-762895e28bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:45.411460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-beda2917-e5ad-4ff4-af37-762895e28bc5 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:45.413638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-beda2917-e5ad-4ff4-af37-762895e28bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:45.457405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:45.523393 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1276/2601] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:45.536769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fa836-0879-4207-980e-3bf92ff503d9 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:45.537195 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fa836-0879-4207-980e-3bf92ff503d9 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:45.537587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fa836-0879-4207-980e-3bf92ff503d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:45.558732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0f0fa836-0879-4207-980e-3bf92ff503d9 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:45.560301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0f0fa836-0879-4207-980e-3bf92ff503d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:45.571477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1326/2602] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:45.578169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda2917-e5ad-4ff4-af37-762895e28bc5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:45.600629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda2917-e5ad-4ff4-af37-762895e28bc5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:45.609537 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7c9e8-93c4-4d69-8f36-f4241c69e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:45.610371 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7c9e8-93c4-4d69-8f36-f4241c69e2ff admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:45.610753 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7c9e8-93c4-4d69-8f36-f4241c69e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:45.611037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7c9e8-93c4-4d69-8f36-f4241c69e2ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:45.611924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7c9e8-93c4-4d69-8f36-f4241c69e2ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:32:45.612236 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7c9e8-93c4-4d69-8f36-f4241c69e2ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:45.613945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7c9e8-93c4-4d69-8f36-f4241c69e2ff admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:45.630038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1277/2603] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:32:45.635191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fa836-0879-4207-980e-3bf92ff503d9 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:45.651754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fa836-0879-4207-980e-3bf92ff503d9 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:45.660249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2801-243b-47d3-bc19-17f3de4d4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:45.661376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2801-243b-47d3-bc19-17f3de4d4fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:45.661843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2801-243b-47d3-bc19-17f3de4d4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:45.662314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2801-243b-47d3-bc19-17f3de4d4fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:45.663974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa2801-243b-47d3-bc19-17f3de4d4fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:45.666227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa2801-243b-47d3-bc19-17f3de4d4fe8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:45.680597 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:45.715373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1327/2604] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:45 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:32:45.716754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7c9e8-93c4-4d69-8f36-f4241c69e2ff admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:45.728370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7c9e8-93c4-4d69-8f36-f4241c69e2ff admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:45.806544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363aea8d-3d51-466b-a9ce-ba8a01e738e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:45.807842 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363aea8d-3d51-466b-a9ce-ba8a01e738e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:45.808392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363aea8d-3d51-466b-a9ce-ba8a01e738e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:45.809009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363aea8d-3d51-466b-a9ce-ba8a01e738e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:45.810355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363aea8d-3d51-466b-a9ce-ba8a01e738e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:45.813966 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363aea8d-3d51-466b-a9ce-ba8a01e738e4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:45.860681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1278/2605] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:45 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:32:45.868766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2801-243b-47d3-bc19-17f3de4d4fe8 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:45.885270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2801-243b-47d3-bc19-17f3de4d4fe8 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:45.895211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f467b4-d971-4197-b5da-a87ae7aec47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:45.896362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f467b4-d971-4197-b5da-a87ae7aec47c admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:45.897070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f467b4-d971-4197-b5da-a87ae7aec47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:45.897533 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f467b4-d971-4197-b5da-a87ae7aec47c admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:45.899128 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f467b4-d971-4197-b5da-a87ae7aec47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:45.903447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f467b4-d971-4197-b5da-a87ae7aec47c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:45.928120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1328/2606] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:45.934323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363aea8d-3d51-466b-a9ce-ba8a01e738e4 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:45.961894 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363aea8d-3d51-466b-a9ce-ba8a01e738e4 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:45.972528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0defd-3d80-48a8-ab39-c5b45e88eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:45.973952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0defd-3d80-48a8-ab39-c5b45e88eb52 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:45.974547 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0defd-3d80-48a8-ab39-c5b45e88eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:45.976195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0defd-3d80-48a8-ab39-c5b45e88eb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:45.977368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0defd-3d80-48a8-ab39-c5b45e88eb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:45.981425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0defd-3d80-48a8-ab39-c5b45e88eb52 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:45.999412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1279/2607] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:46.005510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f467b4-d971-4197-b5da-a87ae7aec47c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:46.024171 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f467b4-d971-4197-b5da-a87ae7aec47c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:46.032735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a471c5-ff98-4b9f-bb3b-a0787264d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:46.034346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a471c5-ff98-4b9f-bb3b-a0787264d374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:46.034893 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a471c5-ff98-4b9f-bb3b-a0787264d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:46.035385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a471c5-ff98-4b9f-bb3b-a0787264d374 admin admin] PATH_INFO: `/v3/projects/0ead3712348245f8862718ef0e30b3c0/users/172df9a596fd4729967f3787533ea57d/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:46.059409 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a471c5-ff98-4b9f-bb3b-a0787264d374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ead3712348245f8862718ef0e30b3c0, user_id=172df9a596fd4729967f3787533ea57d, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:46.063643 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a471c5-ff98-4b9f-bb3b-a0787264d374 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:46.090343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1329/2608] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:46 2022] PUT /identity/v3/projects/0ead3712348245f8862718ef0e30b3c0/users/172df9a596fd4729967f3787533ea57d/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:46.098638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968ac3a-88ca-4d83-8376-be985e50f4c0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:46.099195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968ac3a-88ca-4d83-8376-be985e50f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:46.099670 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968ac3a-88ca-4d83-8376-be985e50f4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:46.134881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1968ac3a-88ca-4d83-8376-be985e50f4c0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:46.136997 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1968ac3a-88ca-4d83-8376-be985e50f4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:46.257168 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1280/2609] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:32:46.268835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a471c5-ff98-4b9f-bb3b-a0787264d374 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:46.271874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-15a471c5-ff98-4b9f-bb3b-a0787264d374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:46.340643 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a471c5-ff98-4b9f-bb3b-a0787264d374 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:46.344831 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5a520-e605-450e-9ba6-dc3f4505f7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:46.345604 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5a520-e605-450e-9ba6-dc3f4505f7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:46.345890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5a520-e605-450e-9ba6-dc3f4505f7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:46.346164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5a520-e605-450e-9ba6-dc3f4505f7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:46.356803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5a520-e605-450e-9ba6-dc3f4505f7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:46.358410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5a520-e605-450e-9ba6-dc3f4505f7eb service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:46.369770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1330/2610] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:51.302789 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968ac3a-88ca-4d83-8376-be985e50f4c0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:51.305174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1968ac3a-88ca-4d83-8376-be985e50f4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:51.356563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968ac3a-88ca-4d83-8376-be985e50f4c0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:51.371458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483d394-1bc0-4514-9c1f-95e12f70078e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:51.377344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483d394-1bc0-4514-9c1f-95e12f70078e service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:51.377788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483d394-1bc0-4514-9c1f-95e12f70078e service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:51.380146 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483d394-1bc0-4514-9c1f-95e12f70078e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:51.388586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5483d394-1bc0-4514-9c1f-95e12f70078e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:51.440989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483d394-1bc0-4514-9c1f-95e12f70078e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:51.443548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483d394-1bc0-4514-9c1f-95e12f70078e service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:51.491250 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1281/2611] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:54.511285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827206c-7d8a-4e5a-aff3-5d69a5468ce1 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:54.512116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827206c-7d8a-4e5a-aff3-5d69a5468ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:54.512116 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827206c-7d8a-4e5a-aff3-5d69a5468ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:54.554869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a827206c-7d8a-4e5a-aff3-5d69a5468ce1 None None] MFA Rules not processed for user `172df9a596fd4729967f3787533ea57d`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:54.556044 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a827206c-7d8a-4e5a-aff3-5d69a5468ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:54.656122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1331/2612] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:54.661285 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483d394-1bc0-4514-9c1f-95e12f70078e service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:54.674536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483d394-1bc0-4514-9c1f-95e12f70078e service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:54.687240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a22dda-bbfd-4ebc-a9df-82e6a03fc696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:54.690978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a22dda-bbfd-4ebc-a9df-82e6a03fc696 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:54.691574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a22dda-bbfd-4ebc-a9df-82e6a03fc696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:54.692014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a22dda-bbfd-4ebc-a9df-82e6a03fc696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:54.692830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a22dda-bbfd-4ebc-a9df-82e6a03fc696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:54.695987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a22dda-bbfd-4ebc-a9df-82e6a03fc696 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:54.729190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:54.741824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1282/2613] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:54 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:54.745572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827206c-7d8a-4e5a-aff3-5d69a5468ce1 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:54.757872 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827206c-7d8a-4e5a-aff3-5d69a5468ce1 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:54.825770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:54.855829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2f5c1-18fd-4337-9d9e-bc53c0a6ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:54.856957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2f5c1-18fd-4337-9d9e-bc53c0a6ed93 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:54.857680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2f5c1-18fd-4337-9d9e-bc53c0a6ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:54.858340 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2f5c1-18fd-4337-9d9e-bc53c0a6ed93 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:54.859201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2f5c1-18fd-4337-9d9e-bc53c0a6ed93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:54.862892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2f5c1-18fd-4337-9d9e-bc53c0a6ed93 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:54.900318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1332/2614] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:54 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:54.905453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a22dda-bbfd-4ebc-a9df-82e6a03fc696 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:54.927525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a22dda-bbfd-4ebc-a9df-82e6a03fc696 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:54.937704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89a2ae-daa3-4cb5-8be2-67666663272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:54.940308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a2ae-daa3-4cb5-8be2-67666663272b admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:54.941298 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a2ae-daa3-4cb5-8be2-67666663272b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:54.942871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a2ae-daa3-4cb5-8be2-67666663272b admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:54.944577 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89a2ae-daa3-4cb5-8be2-67666663272b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:54.948334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89a2ae-daa3-4cb5-8be2-67666663272b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:54.994242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1283/2615] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:54.999711 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2f5c1-18fd-4337-9d9e-bc53c0a6ed93 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:55.022164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2f5c1-18fd-4337-9d9e-bc53c0a6ed93 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:55.032956 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f164e9d-4615-48a7-9b01-ca73a9dcc9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:55.042748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f164e9d-4615-48a7-9b01-ca73a9dcc9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:55.042748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f164e9d-4615-48a7-9b01-ca73a9dcc9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:55.042748 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f164e9d-4615-48a7-9b01-ca73a9dcc9f6 admin admin] PATH_INFO: `/v3/projects/6a265bf2351b4ddd98824cec4b8cd810/users/da84bf4296db4bcb8c524675ba377f44/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:55.079702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f164e9d-4615-48a7-9b01-ca73a9dcc9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a265bf2351b4ddd98824cec4b8cd810, user_id=da84bf4296db4bcb8c524675ba377f44, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:55.088039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f164e9d-4615-48a7-9b01-ca73a9dcc9f6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:55.122072 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1333/2616] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:54 2022] PUT /identity/v3/projects/6a265bf2351b4ddd98824cec4b8cd810/users/da84bf4296db4bcb8c524675ba377f44/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:55.129083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89a2ae-daa3-4cb5-8be2-67666663272b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:55.164283 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89a2ae-daa3-4cb5-8be2-67666663272b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:55.410886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd7ab5-8608-43b4-b346-deacbefbaf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:55.413681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd7ab5-8608-43b4-b346-deacbefbaf83 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:55.422910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd7ab5-8608-43b4-b346-deacbefbaf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:55.423294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd7ab5-8608-43b4-b346-deacbefbaf83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:55.424113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd7ab5-8608-43b4-b346-deacbefbaf83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:55.425832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd7ab5-8608-43b4-b346-deacbefbaf83 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:55.461815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f164e9d-4615-48a7-9b01-ca73a9dcc9f6 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:55.482726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1284/2617] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:32:55.496062 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f164e9d-4615-48a7-9b01-ca73a9dcc9f6 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:55.510127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a338e3-785d-4cab-b03e-0fd0bcb5533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:55.513306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a338e3-785d-4cab-b03e-0fd0bcb5533f admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:55.514050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a338e3-785d-4cab-b03e-0fd0bcb5533f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:55.514381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a338e3-785d-4cab-b03e-0fd0bcb5533f admin admin] PATH_INFO: `/v3/projects/6a265bf2351b4ddd98824cec4b8cd810/users/da84bf4296db4bcb8c524675ba377f44/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:55.525243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a338e3-785d-4cab-b03e-0fd0bcb5533f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a265bf2351b4ddd98824cec4b8cd810, user_id=da84bf4296db4bcb8c524675ba377f44, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:55.529500 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a338e3-785d-4cab-b03e-0fd0bcb5533f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:55.552510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1334/2618] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:32:55 2022] PUT /identity/v3/projects/6a265bf2351b4ddd98824cec4b8cd810/users/da84bf4296db4bcb8c524675ba377f44/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:56.592472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd7ab5-8608-43b4-b346-deacbefbaf83 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:56.726931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd7ab5-8608-43b4-b346-deacbefbaf83 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:56.847808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d3c8-b9a3-4ec5-86db-0d98bf763a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:56.848512 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d3c8-b9a3-4ec5-86db-0d98bf763a51 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:56.849501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d3c8-b9a3-4ec5-86db-0d98bf763a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:56.849845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d3c8-b9a3-4ec5-86db-0d98bf763a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:56.857726 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7883d3c8-b9a3-4ec5-86db-0d98bf763a51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:56.984126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:57.008609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883d3c8-b9a3-4ec5-86db-0d98bf763a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:57.012971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883d3c8-b9a3-4ec5-86db-0d98bf763a51 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:57.031925 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1285/2619] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:58.295480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a338e3-785d-4cab-b03e-0fd0bcb5533f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:58.301263 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e8a338e3-785d-4cab-b03e-0fd0bcb5533f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:58.328891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a338e3-785d-4cab-b03e-0fd0bcb5533f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:58.343102 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:58.344094 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:58.344382 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:58.344656 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] PATH_INFO: `/v3/users/da80b9a52feb462faf0469f2ab701fb8` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:58.347571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=da80b9a52feb462faf0469f2ab701fb8)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:58.349592 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:58.448839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da80b9a52feb462faf0469f2ab701fb8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:58.451050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da80b9a52feb462faf0469f2ab701fb8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:58.452718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da80b9a52feb462faf0469f2ab701fb8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:58.491470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da80b9a52feb462faf0469f2ab701fb8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:58.510444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cb27d0b5-e098-43f7-a430-fea9bfff51ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da80b9a52feb462faf0469f2ab701fb8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:58.552199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1335/2620] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:32:58 2022] DELETE /identity/v3/users/da80b9a52feb462faf0469f2ab701fb8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:32:58.933995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d3c8-b9a3-4ec5-86db-0d98bf763a51 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:58.950050 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d3c8-b9a3-4ec5-86db-0d98bf763a51 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:59.177603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:59.180029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:59.180029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:59.180029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] PATH_INFO: `/v3/projects/1db3fe97f51f47a98da3cbc8f0d55741` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:59.189200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db3fe97f51f47a98da3cbc8f0d55741)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:59.190987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:59.309123 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db3fe97f51f47a98da3cbc8f0d55741', 'request_id': 'req-8c7be1f2-af83-47ba-b186-53b119afeebd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:59.324464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db3fe97f51f47a98da3cbc8f0d55741', 'request_id': 'req-8c7be1f2-af83-47ba-b186-53b119afeebd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:59.349543 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db3fe97f51f47a98da3cbc8f0d55741', 'request_id': 'req-8c7be1f2-af83-47ba-b186-53b119afeebd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:59.375624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] The token cache is being invalidate because project 1db3fe97f51f47a98da3cbc8f0d55741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:32:59.376906 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:59.378154 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8c7be1f2-af83-47ba-b186-53b119afeebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:32:59.385714 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98dc1d-fcca-4c6c-af04-a57b4982a6d3 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:59.386493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98dc1d-fcca-4c6c-af04-a57b4982a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:59.386493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98dc1d-fcca-4c6c-af04-a57b4982a6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:59.386910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1286/2621] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:32:58 2022] DELETE /identity/v3/projects/1db3fe97f51f47a98da3cbc8f0d55741 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:32:59.427725 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-fc98dc1d-fcca-4c6c-af04-a57b4982a6d3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:59.431477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-fc98dc1d-fcca-4c6c-af04-a57b4982a6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:59.678476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176bf99-d4ce-41f5-a46a-5136bf4a5653 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:59.678827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176bf99-d4ce-41f5-a46a-5136bf4a5653 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:59.679058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1336/2622] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:32:59.679169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176bf99-d4ce-41f5-a46a-5136bf4a5653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:59.704399 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a176bf99-d4ce-41f5-a46a-5136bf4a5653 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:59.705734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a176bf99-d4ce-41f5-a46a-5136bf4a5653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:59.731778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98dc1d-fcca-4c6c-af04-a57b4982a6d3 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:59.743358 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1287/2623] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:32:59.756281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98dc1d-fcca-4c6c-af04-a57b4982a6d3 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:59.766420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541cc6-9ce9-4a83-9683-b8247b6bbe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:59.768011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541cc6-9ce9-4a83-9683-b8247b6bbe2f admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:59.768865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541cc6-9ce9-4a83-9683-b8247b6bbe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:59.769625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541cc6-9ce9-4a83-9683-b8247b6bbe2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:59.772800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541cc6-9ce9-4a83-9683-b8247b6bbe2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:32:59.776609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541cc6-9ce9-4a83-9683-b8247b6bbe2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:59.782563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541cc6-9ce9-4a83-9683-b8247b6bbe2f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:59.800251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:59.822961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176bf99-d4ce-41f5-a46a-5136bf4a5653 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:59.832290 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1337/2624] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:32:59.846445 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176bf99-d4ce-41f5-a46a-5136bf4a5653 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:59.857475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3920a-6992-42d7-9da3-66ba5a5413ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:59.870771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3920a-6992-42d7-9da3-66ba5a5413ba admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:59.870771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3920a-6992-42d7-9da3-66ba5a5413ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:59.870771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3920a-6992-42d7-9da3-66ba5a5413ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:59.871647 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3920a-6992-42d7-9da3-66ba5a5413ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:59.874216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3920a-6992-42d7-9da3-66ba5a5413ba admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:59.965835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1288/2625] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:32:59 2022] POST /identity/v3/projects => generated 403 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:32:59.973663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541cc6-9ce9-4a83-9683-b8247b6bbe2f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:00.016256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541cc6-9ce9-4a83-9683-b8247b6bbe2f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:00.261964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60359-402c-4a4e-8f1d-e6e0cfed1762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:00.264329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60359-402c-4a4e-8f1d-e6e0cfed1762 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:00.264774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60359-402c-4a4e-8f1d-e6e0cfed1762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:00.265484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60359-402c-4a4e-8f1d-e6e0cfed1762 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:00.267054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60359-402c-4a4e-8f1d-e6e0cfed1762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:00.271932 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60359-402c-4a4e-8f1d-e6e0cfed1762 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:00.329000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1338/2626] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:32:59 2022] POST /identity/v3/users => generated 302 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:00.335908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3920a-6992-42d7-9da3-66ba5a5413ba admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:00.368638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3920a-6992-42d7-9da3-66ba5a5413ba admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:00.378492 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9c4bb-b56d-43d0-bafd-45e4d40d033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:00.380455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9c4bb-b56d-43d0-bafd-45e4d40d033a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:00.381684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9c4bb-b56d-43d0-bafd-45e4d40d033a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:00.382388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9c4bb-b56d-43d0-bafd-45e4d40d033a admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:00.384287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9c4bb-b56d-43d0-bafd-45e4d40d033a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:00.388837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9c4bb-b56d-43d0-bafd-45e4d40d033a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:00.427813 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1289/2627] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:00.433199 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60359-402c-4a4e-8f1d-e6e0cfed1762 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:00.446812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60359-402c-4a4e-8f1d-e6e0cfed1762 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:00.459760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4bc31-8c0d-468a-baec-7b559c5a9eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:00.460471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4bc31-8c0d-468a-baec-7b559c5a9eda admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:00.460767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4bc31-8c0d-468a-baec-7b559c5a9eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:00.461058 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4bc31-8c0d-468a-baec-7b559c5a9eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:00.461781 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4bc31-8c0d-468a-baec-7b559c5a9eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:00.466213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4bc31-8c0d-468a-baec-7b559c5a9eda admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:00.485389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1339/2628] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:00.492558 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9c4bb-b56d-43d0-bafd-45e4d40d033a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:00.536276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9c4bb-b56d-43d0-bafd-45e4d40d033a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:00.554176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6a727-f042-4488-87cc-47982c3a8409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:00.556452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6a727-f042-4488-87cc-47982c3a8409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:00.557823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6a727-f042-4488-87cc-47982c3a8409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:00.558664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6a727-f042-4488-87cc-47982c3a8409 admin admin] PATH_INFO: `/v3/projects/9978a9594edd4cc9ab50f1cbe965e4b0/users/0a04eb5a692a46c0bcd6835065dc73fb/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:00.602588 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6a727-f042-4488-87cc-47982c3a8409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9978a9594edd4cc9ab50f1cbe965e4b0, user_id=0a04eb5a692a46c0bcd6835065dc73fb, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:00.611577 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6a727-f042-4488-87cc-47982c3a8409 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:00.648213 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1290/2629] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:00 2022] PUT /identity/v3/projects/9978a9594edd4cc9ab50f1cbe965e4b0/users/0a04eb5a692a46c0bcd6835065dc73fb/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:00.659623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c111-ae36-41ad-91da-144625ef5a50 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:00.660461 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c111-ae36-41ad-91da-144625ef5a50 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:00.661054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c111-ae36-41ad-91da-144625ef5a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:00.703970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-0c11c111-ae36-41ad-91da-144625ef5a50 None None] MFA Rules not processed for user `0a04eb5a692a46c0bcd6835065dc73fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:00.705247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-0c11c111-ae36-41ad-91da-144625ef5a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:00.824155 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1340/2630] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:00.824299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6a727-f042-4488-87cc-47982c3a8409 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:00.849723 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:00.942049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6a727-f042-4488-87cc-47982c3a8409 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:00.955038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e980-43b4-4433-b518-b6e8589f507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:00.957126 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e980-43b4-4433-b518-b6e8589f507c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:00.957449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e980-43b4-4433-b518-b6e8589f507c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:00.957887 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e980-43b4-4433-b518-b6e8589f507c admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:00.959042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163e980-43b4-4433-b518-b6e8589f507c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:00.966058 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163e980-43b4-4433-b518-b6e8589f507c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:01.015998 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1291/2631] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:00 2022] POST /identity/v3/projects => generated 403 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:33:01.020673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c111-ae36-41ad-91da-144625ef5a50 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:01.033791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c111-ae36-41ad-91da-144625ef5a50 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:01.190937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347ebfa-9f8c-4abc-abb4-1579b61e398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:01.202398 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347ebfa-9f8c-4abc-abb4-1579b61e398c admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:01.202800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347ebfa-9f8c-4abc-abb4-1579b61e398c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:01.203235 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347ebfa-9f8c-4abc-abb4-1579b61e398c admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:01.204431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347ebfa-9f8c-4abc-abb4-1579b61e398c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:01.207934 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347ebfa-9f8c-4abc-abb4-1579b61e398c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:01.247139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:01.297520 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e980-43b4-4433-b518-b6e8589f507c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:01.315287 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1341/2632] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:01 2022] POST /identity/v3/users => generated 308 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:01.328712 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e980-43b4-4433-b518-b6e8589f507c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:01.339329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f8b0b-796d-4a72-976a-b7c7b44b99b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:01.345510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f8b0b-796d-4a72-976a-b7c7b44b99b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:01.346217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f8b0b-796d-4a72-976a-b7c7b44b99b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:01.346870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f8b0b-796d-4a72-976a-b7c7b44b99b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:01.348300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f8b0b-796d-4a72-976a-b7c7b44b99b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:01.353609 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f8b0b-796d-4a72-976a-b7c7b44b99b7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:01.386948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1292/2633] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:01.396193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347ebfa-9f8c-4abc-abb4-1579b61e398c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:01.411069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347ebfa-9f8c-4abc-abb4-1579b61e398c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:01.416363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043e519-697a-4591-b9c1-c2145f082280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:01.417454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e519-697a-4591-b9c1-c2145f082280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:01.417752 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e519-697a-4591-b9c1-c2145f082280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:01.418034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e519-697a-4591-b9c1-c2145f082280 admin admin] PATH_INFO: `/v3/projects/0914a0f2d90140d88ca5cb757ff91f3e/users/8c775bd2e441467c81624761ce6100f7/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:01.437746 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043e519-697a-4591-b9c1-c2145f082280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0914a0f2d90140d88ca5cb757ff91f3e, user_id=8c775bd2e441467c81624761ce6100f7, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:01.440854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043e519-697a-4591-b9c1-c2145f082280 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:01.503624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1342/2634] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:01 2022] PUT /identity/v3/projects/0914a0f2d90140d88ca5cb757ff91f3e/users/8c775bd2e441467c81624761ce6100f7/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:01.510096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f8b0b-796d-4a72-976a-b7c7b44b99b7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:01.541038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f8b0b-796d-4a72-976a-b7c7b44b99b7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:01.729057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb35b7-f675-4056-822e-37381fd89c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:01.729790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb35b7-f675-4056-822e-37381fd89c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:01.730155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb35b7-f675-4056-822e-37381fd89c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:01.730343 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb35b7-f675-4056-822e-37381fd89c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:01.731427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb35b7-f675-4056-822e-37381fd89c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:01.733250 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb35b7-f675-4056-822e-37381fd89c48 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:01.764954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1293/2635] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:01.767858 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043e519-697a-4591-b9c1-c2145f082280 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:01.787501 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043e519-697a-4591-b9c1-c2145f082280 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:01.801135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78e97-feef-4461-89c6-77ad0c9486b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:01.802087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78e97-feef-4461-89c6-77ad0c9486b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:01.802367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78e97-feef-4461-89c6-77ad0c9486b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:01.802730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78e97-feef-4461-89c6-77ad0c9486b2 admin admin] PATH_INFO: `/v3/projects/0914a0f2d90140d88ca5cb757ff91f3e/users/8c775bd2e441467c81624761ce6100f7/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:01.808678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d78e97-feef-4461-89c6-77ad0c9486b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0914a0f2d90140d88ca5cb757ff91f3e, user_id=8c775bd2e441467c81624761ce6100f7, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:01.814444 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d78e97-feef-4461-89c6-77ad0c9486b2 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:01.857916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1343/2636] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:01 2022] PUT /identity/v3/projects/0914a0f2d90140d88ca5cb757ff91f3e/users/8c775bd2e441467c81624761ce6100f7/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:01.881027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f43e5e-0937-420d-9f9d-986485cee172 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:01.881357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f43e5e-0937-420d-9f9d-986485cee172 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:01.881791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f43e5e-0937-420d-9f9d-986485cee172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:01.957006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-82f43e5e-0937-420d-9f9d-986485cee172 None None] MFA Rules not processed for user `8c775bd2e441467c81624761ce6100f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:01.961425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-82f43e5e-0937-420d-9f9d-986485cee172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:02.173555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1294/2637] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:02.206719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78e97-feef-4461-89c6-77ad0c9486b2 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:02.208800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d6d78e97-feef-4461-89c6-77ad0c9486b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:02.318138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78e97-feef-4461-89c6-77ad0c9486b2 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:02.326353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b9315-fdb0-4a33-af33-e6c6c983c503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:02.328097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9315-fdb0-4a33-af33-e6c6c983c503 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:02.328959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9315-fdb0-4a33-af33-e6c6c983c503 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:02.329958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9315-fdb0-4a33-af33-e6c6c983c503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:02.347564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b9315-fdb0-4a33-af33-e6c6c983c503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:02.353138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b9315-fdb0-4a33-af33-e6c6c983c503 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:02.385232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1344/2638] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:02.588082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f43e5e-0937-420d-9f9d-986485cee172 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:02.604586 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:02.674148 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f43e5e-0937-420d-9f9d-986485cee172 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:02.683453 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:02.684458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:02.684869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:02.685219 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] PATH_INFO: `/v3/users/0a04eb5a692a46c0bcd6835065dc73fb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:02.687710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a04eb5a692a46c0bcd6835065dc73fb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:02.690275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:02.709647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b9315-fdb0-4a33-af33-e6c6c983c503 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:02.713273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-074b9315-fdb0-4a33-af33-e6c6c983c503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:02.787879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a04eb5a692a46c0bcd6835065dc73fb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:02.810473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a04eb5a692a46c0bcd6835065dc73fb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:02.811605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a04eb5a692a46c0bcd6835065dc73fb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:02.849843 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a04eb5a692a46c0bcd6835065dc73fb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:02.864442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8ed4632a-bf7e-4297-967d-9e58bb185ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a04eb5a692a46c0bcd6835065dc73fb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:02.873257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1295/2639] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:02 2022] DELETE /identity/v3/users/0a04eb5a692a46c0bcd6835065dc73fb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:02.879665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499596-d230-4bab-bc4a-b1bd6b237feb None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:02.880287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499596-d230-4bab-bc4a-b1bd6b237feb None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:02.880662 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499596-d230-4bab-bc4a-b1bd6b237feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:02.914408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b9315-fdb0-4a33-af33-e6c6c983c503 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:02.937044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1b499596-d230-4bab-bc4a-b1bd6b237feb None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:02.939312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1b499596-d230-4bab-bc4a-b1bd6b237feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:03.062837 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f22644-9b48-4237-aceb-490ccd22d04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:03.063931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f22644-9b48-4237-aceb-490ccd22d04d service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:03.064423 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f22644-9b48-4237-aceb-490ccd22d04d service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:03.064930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f22644-9b48-4237-aceb-490ccd22d04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:03.076168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-34f22644-9b48-4237-aceb-490ccd22d04d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:03.138804 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1296/2640] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:03.142552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b499596-d230-4bab-bc4a-b1bd6b237feb None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:03.145372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1b499596-d230-4bab-bc4a-b1bd6b237feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:03.167753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:03.179090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b499596-d230-4bab-bc4a-b1bd6b237feb None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:03.186484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c649-cfba-497c-ad22-669656e8f9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:03.188421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c649-cfba-497c-ad22-669656e8f9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:03.189522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c649-cfba-497c-ad22-669656e8f9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:03.190019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c649-cfba-497c-ad22-669656e8f9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:03.222686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56c649-cfba-497c-ad22-669656e8f9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:03.230128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56c649-cfba-497c-ad22-669656e8f9e5 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:03.274359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1297/2641] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:03.344303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f22644-9b48-4237-aceb-490ccd22d04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:03.346033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f22644-9b48-4237-aceb-490ccd22d04d service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:03.405693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1345/2642] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:04.085120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c649-cfba-497c-ad22-669656e8f9e5 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:04.090043 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7b56c649-cfba-497c-ad22-669656e8f9e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:04.143395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c649-cfba-497c-ad22-669656e8f9e5 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:04.184570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:04.186611 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:04.187098 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:04.187525 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] PATH_INFO: `/v3/projects/9978a9594edd4cc9ab50f1cbe965e4b0` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:04.189202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9978a9594edd4cc9ab50f1cbe965e4b0)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:04.191474 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:04.214832 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:04.318429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9978a9594edd4cc9ab50f1cbe965e4b0', 'request_id': 'req-b13b0407-a9f0-4918-bb70-b1a94ee366b3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:04.332312 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9978a9594edd4cc9ab50f1cbe965e4b0', 'request_id': 'req-b13b0407-a9f0-4918-bb70-b1a94ee366b3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:04.359151 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9978a9594edd4cc9ab50f1cbe965e4b0', 'request_id': 'req-b13b0407-a9f0-4918-bb70-b1a94ee366b3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:04.381109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] The token cache is being invalidate because project 9978a9594edd4cc9ab50f1cbe965e4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:04.382117 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:04.386341 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:04.396230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1298/2643] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:04 2022] DELETE /identity/v3/projects/9978a9594edd4cc9ab50f1cbe965e4b0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:04.397647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f22644-9b48-4237-aceb-490ccd22d04d service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:04.432435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f22644-9b48-4237-aceb-490ccd22d04d service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:04.544886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:04.546946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:04.546946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:04.546946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] PATH_INFO: `/v3/users/8c775bd2e441467c81624761ce6100f7` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:04.549097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c775bd2e441467c81624761ce6100f7)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:04.552306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:04.690992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c775bd2e441467c81624761ce6100f7'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:04.692560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c775bd2e441467c81624761ce6100f7'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:04.699020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c775bd2e441467c81624761ce6100f7'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:04.784871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c775bd2e441467c81624761ce6100f7'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:04.821397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c775bd2e441467c81624761ce6100f7'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:04.863791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1346/2644] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:04 2022] DELETE /identity/v3/users/8c775bd2e441467c81624761ce6100f7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:06.647212 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:06.649708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:06.700721 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b0407-a9f0-4918-bb70-b1a94ee366b3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:06.733278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:06.737406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:06.845180 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:06.983415 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4f605-7505-459b-a987-3511390ff4ff admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:07.001188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:07.002140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:07.002465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:07.002734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] PATH_INFO: `/v3/users/60dbe36087e14f9e8bf885977b0e7426` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:07.005400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60dbe36087e14f9e8bf885977b0e7426)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:07.007591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:07.009355 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:07.010211 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:07.013382 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:07.014377 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] PATH_INFO: `/v3/projects/0914a0f2d90140d88ca5cb757ff91f3e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:07.020091 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0914a0f2d90140d88ca5cb757ff91f3e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:07.033106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:07.154798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60dbe36087e14f9e8bf885977b0e7426'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:07.156775 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60dbe36087e14f9e8bf885977b0e7426'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:07.158786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60dbe36087e14f9e8bf885977b0e7426'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:07.196323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0914a0f2d90140d88ca5cb757ff91f3e', 'request_id': 'req-f11b1680-deba-425e-b974-073887df1d97'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:07.211609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60dbe36087e14f9e8bf885977b0e7426'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:07.218645 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0914a0f2d90140d88ca5cb757ff91f3e', 'request_id': 'req-f11b1680-deba-425e-b974-073887df1d97'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:07.236613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3fa331da-a2ec-40a4-ae00-1387ed8402b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60dbe36087e14f9e8bf885977b0e7426'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:07.245033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0914a0f2d90140d88ca5cb757ff91f3e', 'request_id': 'req-f11b1680-deba-425e-b974-073887df1d97'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:07.273210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] The token cache is being invalidate because project 0914a0f2d90140d88ca5cb757ff91f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:07.273735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1347/2645] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:06 2022] DELETE /identity/v3/users/60dbe36087e14f9e8bf885977b0e7426 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:07.274619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:07.276194 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f11b1680-deba-425e-b974-073887df1d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:07.282016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1299/2646] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:06 2022] DELETE /identity/v3/projects/0914a0f2d90140d88ca5cb757ff91f3e => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:07.287953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8c9a-aa04-4236-9c23-a5f187ba7102 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:07.288291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8c9a-aa04-4236-9c23-a5f187ba7102 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:07.288646 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8c9a-aa04-4236-9c23-a5f187ba7102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:07.323020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9b9c8c9a-aa04-4236-9c23-a5f187ba7102 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:07.329657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9b9c8c9a-aa04-4236-9c23-a5f187ba7102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:07.576734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1348/2647] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:07.580394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6ad3b-855d-47f3-b933-202f1444addc None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:07.580394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6ad3b-855d-47f3-b933-202f1444addc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:07.581013 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6ad3b-855d-47f3-b933-202f1444addc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:07.672924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-49f6ad3b-855d-47f3-b933-202f1444addc None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:07.680467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-49f6ad3b-855d-47f3-b933-202f1444addc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:07.728841 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1300/2648] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:07.734727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c8c9a-aa04-4236-9c23-a5f187ba7102 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:07.750810 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c8c9a-aa04-4236-9c23-a5f187ba7102 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:07.762087 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6d086-9c6b-4c82-80cf-1b9fa2df86e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:07.762835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6d086-9c6b-4c82-80cf-1b9fa2df86e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:07.763151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6d086-9c6b-4c82-80cf-1b9fa2df86e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:07.763418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6d086-9c6b-4c82-80cf-1b9fa2df86e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:07.764818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6d086-9c6b-4c82-80cf-1b9fa2df86e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:33:07.764818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6d086-9c6b-4c82-80cf-1b9fa2df86e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:07.772403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6d086-9c6b-4c82-80cf-1b9fa2df86e3 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:07.869933 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6ad3b-855d-47f3-b933-202f1444addc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:07.871560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1349/2649] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:33:07.886397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6ad3b-855d-47f3-b933-202f1444addc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:07.899608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cab0f1-bbbc-4606-9da1-0f59060229e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:07.900313 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cab0f1-bbbc-4606-9da1-0f59060229e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:07.900780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cab0f1-bbbc-4606-9da1-0f59060229e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:07.901224 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cab0f1-bbbc-4606-9da1-0f59060229e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:07.902259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cab0f1-bbbc-4606-9da1-0f59060229e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:07.909881 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cab0f1-bbbc-4606-9da1-0f59060229e6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:08.001679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1301/2650] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:07 2022] POST /identity/v3/projects => generated 357 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:33:08.007045 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6d086-9c6b-4c82-80cf-1b9fa2df86e3 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:08.077747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6d086-9c6b-4c82-80cf-1b9fa2df86e3 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:08.112907 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cab0f1-bbbc-4606-9da1-0f59060229e6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:08.116124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-78cab0f1-bbbc-4606-9da1-0f59060229e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:08.122596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:08.226477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:08.358150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faa922-8356-4ceb-8a81-7bf8ce34ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:08.359179 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faa922-8356-4ceb-8a81-7bf8ce34ae17 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:08.359683 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faa922-8356-4ceb-8a81-7bf8ce34ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:08.360188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faa922-8356-4ceb-8a81-7bf8ce34ae17 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:08.361483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faa922-8356-4ceb-8a81-7bf8ce34ae17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:08.365219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faa922-8356-4ceb-8a81-7bf8ce34ae17 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:08.387651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cab0f1-bbbc-4606-9da1-0f59060229e6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:08.398532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:08.399822 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:08.400165 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:08.400576 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] PATH_INFO: `/v3/projects/5d4c799515b04fff924caa9819be4faf` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:08.404653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4c799515b04fff924caa9819be4faf)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:08.410190 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:08.486495 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1350/2651] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:08 2022] POST /identity/v3/users => generated 279 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:08.488519 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968a80-3311-4f9d-a4bb-5242e4a546fb None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:08.488995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968a80-3311-4f9d-a4bb-5242e4a546fb None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:08.489283 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968a80-3311-4f9d-a4bb-5242e4a546fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:08.557138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c3968a80-3311-4f9d-a4bb-5242e4a546fb None None] MFA Rules not processed for user `da84bf4296db4bcb8c524675ba377f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:08.557138 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c3968a80-3311-4f9d-a4bb-5242e4a546fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:08.568862 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4c799515b04fff924caa9819be4faf', 'request_id': 'req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:08.582710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4c799515b04fff924caa9819be4faf', 'request_id': 'req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:08.602788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4c799515b04fff924caa9819be4faf', 'request_id': 'req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:08.643017 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] The token cache is being invalidate because project 5d4c799515b04fff924caa9819be4faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:08.643486 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:08.644448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:08.650655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1302/2652] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:08 2022] DELETE /identity/v3/projects/5d4c799515b04fff924caa9819be4faf => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:08.651823 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:08.666846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:08.776518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7b7b-4ff2-48f8-b73c-80ebf77ab472 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:08.789202 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820f034-12bf-4aec-98de-da7f32dadad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:08.790254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820f034-12bf-4aec-98de-da7f32dadad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:08.791802 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820f034-12bf-4aec-98de-da7f32dadad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:08.792310 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820f034-12bf-4aec-98de-da7f32dadad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:08.793736 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820f034-12bf-4aec-98de-da7f32dadad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:08.798591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820f034-12bf-4aec-98de-da7f32dadad6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:08.821169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1303/2653] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:08.823563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efc668-bdc1-42a7-b608-17d99de75612 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:08.824062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efc668-bdc1-42a7-b608-17d99de75612 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:08.824519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efc668-bdc1-42a7-b608-17d99de75612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:08.857578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a1efc668-bdc1-42a7-b608-17d99de75612 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:08.859860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a1efc668-bdc1-42a7-b608-17d99de75612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:08.875830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1304/2654] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:08.877406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efc668-bdc1-42a7-b608-17d99de75612 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:08.882035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1351/2655] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:08.884813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf46bc-86be-4e8a-8f96-114e2b31c9d0 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:08.885284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf46bc-86be-4e8a-8f96-114e2b31c9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:08.886108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf46bc-86be-4e8a-8f96-114e2b31c9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:08.928485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9caf46bc-86be-4e8a-8f96-114e2b31c9d0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:08.930491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9caf46bc-86be-4e8a-8f96-114e2b31c9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:08.931167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efc668-bdc1-42a7-b608-17d99de75612 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:08.940114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782377f1-66b1-426b-b37b-9ced675016ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:08.943724 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782377f1-66b1-426b-b37b-9ced675016ad admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:08.943724 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782377f1-66b1-426b-b37b-9ced675016ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:08.944645 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782377f1-66b1-426b-b37b-9ced675016ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:08.946184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782377f1-66b1-426b-b37b-9ced675016ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:08.950353 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782377f1-66b1-426b-b37b-9ced675016ad admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:08.961031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1352/2656] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:08.964491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf46bc-86be-4e8a-8f96-114e2b31c9d0 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:08.966953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9caf46bc-86be-4e8a-8f96-114e2b31c9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:08.977212 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1305/2657] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:08.978758 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782377f1-66b1-426b-b37b-9ced675016ad admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:08.999850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782377f1-66b1-426b-b37b-9ced675016ad admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:09.010386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d577b7-66f6-408f-a704-ea20415f1a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:09.011910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d577b7-66f6-408f-a704-ea20415f1a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:09.012565 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d577b7-66f6-408f-a704-ea20415f1a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:09.013107 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d577b7-66f6-408f-a704-ea20415f1a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:09.021076 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d577b7-66f6-408f-a704-ea20415f1a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:33:09.021593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d577b7-66f6-408f-a704-ea20415f1a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:09.023454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d577b7-66f6-408f-a704-ea20415f1a9c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:09.049421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:09.069820 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1306/2658] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:33:09.069820 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d577b7-66f6-408f-a704-ea20415f1a9c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:09.094364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d577b7-66f6-408f-a704-ea20415f1a9c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:09.106217 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d994d8a-e4d9-4e23-b2b1-3523b2bee6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:09.107309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994d8a-e4d9-4e23-b2b1-3523b2bee6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:09.108344 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994d8a-e4d9-4e23-b2b1-3523b2bee6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:09.108632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994d8a-e4d9-4e23-b2b1-3523b2bee6d2 admin admin] PATH_INFO: `/v3/projects/a6a39f5ab6904afd99f72c94ef68098b/users/87b5a8a8dc544c449faa689517fb798e/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:09.135821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d994d8a-e4d9-4e23-b2b1-3523b2bee6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a39f5ab6904afd99f72c94ef68098b, user_id=87b5a8a8dc544c449faa689517fb798e, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:09.138803 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d994d8a-e4d9-4e23-b2b1-3523b2bee6d2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:09.139343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf46bc-86be-4e8a-8f96-114e2b31c9d0 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:09.146986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58809e-26ff-44ef-b982-5edff7023dec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0055a33a380435d83a6d7384417c10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:09.148530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58809e-26ff-44ef-b982-5edff7023dec service glance] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:09.149132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58809e-26ff-44ef-b982-5edff7023dec service glance] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:09.149737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58809e-26ff-44ef-b982-5edff7023dec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:09.153911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cb58809e-26ff-44ef-b982-5edff7023dec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:09.158268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1307/2659] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:09 2022] PUT /identity/v3/projects/a6a39f5ab6904afd99f72c94ef68098b/users/87b5a8a8dc544c449faa689517fb798e/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:09.170819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d994d8a-e4d9-4e23-b2b1-3523b2bee6d2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:09.173820 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7d994d8a-e4d9-4e23-b2b1-3523b2bee6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:09.228188 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:09.250275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58809e-26ff-44ef-b982-5edff7023dec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:09.252011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58809e-26ff-44ef-b982-5edff7023dec service glance] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:09.276641 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1353/2660] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:09.277517 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58809e-26ff-44ef-b982-5edff7023dec service glance] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:09.295567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58809e-26ff-44ef-b982-5edff7023dec service glance] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:09.351287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d994d8a-e4d9-4e23-b2b1-3523b2bee6d2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:09.367100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc6ecf-e7d7-4add-a3ce-3684f613553a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:09.369136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc6ecf-e7d7-4add-a3ce-3684f613553a service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:09.370029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc6ecf-e7d7-4add-a3ce-3684f613553a service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:09.370813 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc6ecf-e7d7-4add-a3ce-3684f613553a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:09.374942 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d3cc6ecf-e7d7-4add-a3ce-3684f613553a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:09.407095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc6ecf-e7d7-4add-a3ce-3684f613553a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:09.418191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc6ecf-e7d7-4add-a3ce-3684f613553a service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:09.441955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1308/2661] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:09.443551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2b411-8cc7-48a9-b8c7-b7b2ae90dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:09.444189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2b411-8cc7-48a9-b8c7-b7b2ae90dc33 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:09.444472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2b411-8cc7-48a9-b8c7-b7b2ae90dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:09.445177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2b411-8cc7-48a9-b8c7-b7b2ae90dc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:09.445309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca168-54a5-4fc5-83f8-8b503be59dd5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:09.445309 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca168-54a5-4fc5-83f8-8b503be59dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:09.445532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2b411-8cc7-48a9-b8c7-b7b2ae90dc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:09.445948 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca168-54a5-4fc5-83f8-8b503be59dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:09.459549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2b411-8cc7-48a9-b8c7-b7b2ae90dc33 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:09.568853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1354/2662] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:09 2022] POST /identity/v3/projects => generated 381 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:09.570385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefbad3-8100-41f4-b419-2664b425a190 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:09.570811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefbad3-8100-41f4-b419-2664b425a190 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:09.571028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefbad3-8100-41f4-b419-2664b425a190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:09.596619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9aefbad3-8100-41f4-b419-2664b425a190 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:09.596893 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-48fca168-54a5-4fc5-83f8-8b503be59dd5 None None] MFA Rules not processed for user `87b5a8a8dc544c449faa689517fb798e`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:09.598686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-48fca168-54a5-4fc5-83f8-8b503be59dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:09.601795 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9aefbad3-8100-41f4-b419-2664b425a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:09.730638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1309/2663] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:09.731548 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fca168-54a5-4fc5-83f8-8b503be59dd5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:09.747243 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1355/2664] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:09.748185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefbad3-8100-41f4-b419-2664b425a190 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:09.802028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:09.922421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:09.926787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fca168-54a5-4fc5-83f8-8b503be59dd5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:09.934630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1dfd9-abe4-429a-b2ac-76f62056468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:09.935552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1dfd9-abe4-429a-b2ac-76f62056468b admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:09.937128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1dfd9-abe4-429a-b2ac-76f62056468b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:09.937554 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1dfd9-abe4-429a-b2ac-76f62056468b admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:09.939963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1dfd9-abe4-429a-b2ac-76f62056468b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:09.942261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1dfd9-abe4-429a-b2ac-76f62056468b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:09.946000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefbad3-8100-41f4-b419-2664b425a190 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:09.954346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce1a4d-3558-42a6-a480-3453635c26ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:09.955498 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce1a4d-3558-42a6-a480-3453635c26ff admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:09.956695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce1a4d-3558-42a6-a480-3453635c26ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:09.956991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce1a4d-3558-42a6-a480-3453635c26ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:09.958219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce1a4d-3558-42a6-a480-3453635c26ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:09.961973 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce1a4d-3558-42a6-a480-3453635c26ff admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:09.968352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1310/2665] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:09 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:09.968352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1dfd9-abe4-429a-b2ac-76f62056468b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:09.968352 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e1b1dfd9-abe4-429a-b2ac-76f62056468b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:10.012584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1356/2666] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:09 2022] POST /identity/v3/projects => generated 357 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:10.014442 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce1a4d-3558-42a6-a480-3453635c26ff admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:10.118229 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce1a4d-3558-42a6-a480-3453635c26ff admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.119185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1dfd9-abe4-429a-b2ac-76f62056468b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.124467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299cb54-a882-4a28-a7cb-05fe3a41c902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.125606 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299cb54-a882-4a28-a7cb-05fe3a41c902 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.126001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299cb54-a882-4a28-a7cb-05fe3a41c902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.126383 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299cb54-a882-4a28-a7cb-05fe3a41c902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.127360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299cb54-a882-4a28-a7cb-05fe3a41c902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:10.129241 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299cb54-a882-4a28-a7cb-05fe3a41c902 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:10.143246 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1357/2667] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:10.144304 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299cb54-a882-4a28-a7cb-05fe3a41c902 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:10.159361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299cb54-a882-4a28-a7cb-05fe3a41c902 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.167373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777d897-8c67-46a6-b4d2-ee8ac351e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.167905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777d897-8c67-46a6-b4d2-ee8ac351e7fe admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.168418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777d897-8c67-46a6-b4d2-ee8ac351e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.168743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777d897-8c67-46a6-b4d2-ee8ac351e7fe admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.169583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777d897-8c67-46a6-b4d2-ee8ac351e7fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:10.172569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777d897-8c67-46a6-b4d2-ee8ac351e7fe admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:10.212677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1358/2668] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:10 2022] POST /identity/v3/users => generated 285 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:10.212677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777d897-8c67-46a6-b4d2-ee8ac351e7fe admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:10.231408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777d897-8c67-46a6-b4d2-ee8ac351e7fe admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.240131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e51522-3a85-41b3-900d-bb4f536df4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.241431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e51522-3a85-41b3-900d-bb4f536df4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.241878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e51522-3a85-41b3-900d-bb4f536df4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.242222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e51522-3a85-41b3-900d-bb4f536df4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.243117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e51522-3a85-41b3-900d-bb4f536df4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:10.246463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e51522-3a85-41b3-900d-bb4f536df4ad admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:10.248124 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c6a13-c9c4-4ecf-9591-503671191f84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.249250 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c6a13-c9c4-4ecf-9591-503671191f84 service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.249729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c6a13-c9c4-4ecf-9591-503671191f84 service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.250196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c6a13-c9c4-4ecf-9591-503671191f84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.266168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1359/2669] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:10.270904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e51522-3a85-41b3-900d-bb4f536df4ad admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:10.277192 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:10.284849 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e51522-3a85-41b3-900d-bb4f536df4ad admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.291433 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a2e00-034e-4e80-a309-8e0b7887e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.292182 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a2e00-034e-4e80-a309-8e0b7887e68b admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.292470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a2e00-034e-4e80-a309-8e0b7887e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.293438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a2e00-034e-4e80-a309-8e0b7887e68b admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.294306 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a2e00-034e-4e80-a309-8e0b7887e68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:10.296213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a2e00-034e-4e80-a309-8e0b7887e68b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:10.311625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1360/2670] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:10.312637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a2e00-034e-4e80-a309-8e0b7887e68b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:10.328331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a2e00-034e-4e80-a309-8e0b7887e68b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.335706 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c6c60-fedc-4d4d-8b0d-e46ac16a9c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.337318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c6c60-fedc-4d4d-8b0d-e46ac16a9c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.337745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c6c60-fedc-4d4d-8b0d-e46ac16a9c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.337874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c6c60-fedc-4d4d-8b0d-e46ac16a9c6d admin admin] PATH_INFO: `/v3/projects/c21821c1aa3142738d9b8fc10517f490/users/95a0ce215c694563b419863e77e2269d/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.365786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c6a13-c9c4-4ecf-9591-503671191f84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:10.368880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c6a13-c9c4-4ecf-9591-503671191f84 service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:10.381832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c6c60-fedc-4d4d-8b0d-e46ac16a9c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21821c1aa3142738d9b8fc10517f490, user_id=95a0ce215c694563b419863e77e2269d, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:10.385219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c6c60-fedc-4d4d-8b0d-e46ac16a9c6d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:10.391577 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1311/2671] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:33:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:33:10.392407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c6a13-c9c4-4ecf-9591-503671191f84 service swift] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:10.410198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c6a13-c9c4-4ecf-9591-503671191f84 service swift] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.412331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1361/2672] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:10 2022] PUT /identity/v3/projects/c21821c1aa3142738d9b8fc10517f490/users/95a0ce215c694563b419863e77e2269d/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:10.462805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258c9d6-b4cf-41fa-bd2b-07392e5665b8 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.464050 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258c9d6-b4cf-41fa-bd2b-07392e5665b8 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.464552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258c9d6-b4cf-41fa-bd2b-07392e5665b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.553681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-3258c9d6-b4cf-41fa-bd2b-07392e5665b8 None None] MFA Rules not processed for user `95a0ce215c694563b419863e77e2269d`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:10.554897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e206b-661e-42bb-9144-76549f3bf978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.556466 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e206b-661e-42bb-9144-76549f3bf978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.556959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e206b-661e-42bb-9144-76549f3bf978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.557431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e206b-661e-42bb-9144-76549f3bf978 admin admin] PATH_INFO: `/v3/projects/19fc9f4270b4402cae15062b92ebb7d6/users/e1a17d5d22ca44869ed9a92b4216830d/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.560999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3258c9d6-b4cf-41fa-bd2b-07392e5665b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:10.586612 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e206b-661e-42bb-9144-76549f3bf978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fc9f4270b4402cae15062b92ebb7d6, user_id=e1a17d5d22ca44869ed9a92b4216830d, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:10.592345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e206b-661e-42bb-9144-76549f3bf978 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:10.672204 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1312/2673] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:10 2022] PUT /identity/v3/projects/19fc9f4270b4402cae15062b92ebb7d6/users/e1a17d5d22ca44869ed9a92b4216830d/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:10.677442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e206b-661e-42bb-9144-76549f3bf978 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:10.783979 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:10.799177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1362/2674] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:10.807827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258c9d6-b4cf-41fa-bd2b-07392e5665b8 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:10.849997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258c9d6-b4cf-41fa-bd2b-07392e5665b8 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.872655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e206b-661e-42bb-9144-76549f3bf978 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.880828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccc9d2-a7e0-4f5e-a9bb-c86af169477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.883689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccc9d2-a7e0-4f5e-a9bb-c86af169477e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.884027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccc9d2-a7e0-4f5e-a9bb-c86af169477e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.886061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccc9d2-a7e0-4f5e-a9bb-c86af169477e admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.887160 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccc9d2-a7e0-4f5e-a9bb-c86af169477e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:10.892626 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccc9d2-a7e0-4f5e-a9bb-c86af169477e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:10.903476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee95c27-dd10-4af2-ac85-4523216e2b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.907538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee95c27-dd10-4af2-ac85-4523216e2b5f admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.908492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee95c27-dd10-4af2-ac85-4523216e2b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.915022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1313/2675] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:10.916097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee95c27-dd10-4af2-ac85-4523216e2b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.917401 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee95c27-dd10-4af2-ac85-4523216e2b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:10.921277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee95c27-dd10-4af2-ac85-4523216e2b5f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:10.923827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccc9d2-a7e0-4f5e-a9bb-c86af169477e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:10.954038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccc9d2-a7e0-4f5e-a9bb-c86af169477e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.987529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373ab6d-05f9-4647-89f6-fc2b9b2daa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.988691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ab6d-05f9-4647-89f6-fc2b9b2daa22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.989147 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ab6d-05f9-4647-89f6-fc2b9b2daa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.990042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ab6d-05f9-4647-89f6-fc2b9b2daa22 admin admin] PATH_INFO: `/v3/projects/19fc9f4270b4402cae15062b92ebb7d6/users/e1a17d5d22ca44869ed9a92b4216830d/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.998121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373ab6d-05f9-4647-89f6-fc2b9b2daa22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fc9f4270b4402cae15062b92ebb7d6, user_id=e1a17d5d22ca44869ed9a92b4216830d, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:11.008905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373ab6d-05f9-4647-89f6-fc2b9b2daa22 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:11.019692 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1363/2676] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:10 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:11.025046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee95c27-dd10-4af2-ac85-4523216e2b5f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:11.079659 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1314/2677] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:10 2022] PUT /identity/v3/projects/19fc9f4270b4402cae15062b92ebb7d6/users/e1a17d5d22ca44869ed9a92b4216830d/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:11.086977 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27713fc7-1815-4f15-9266-252a08e9f8ed None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:11.087537 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27713fc7-1815-4f15-9266-252a08e9f8ed None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:11.088655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27713fc7-1815-4f15-9266-252a08e9f8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:11.238216 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-27713fc7-1815-4f15-9266-252a08e9f8ed None None] MFA Rules not processed for user `e1a17d5d22ca44869ed9a92b4216830d`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:11.241271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-27713fc7-1815-4f15-9266-252a08e9f8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:11.255360 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:11.312760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee95c27-dd10-4af2-ac85-4523216e2b5f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:11.430481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e7e6f-9f04-4e48-a8ea-4f475708d14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:11.431385 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e7e6f-9f04-4e48-a8ea-4f475708d14a admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:11.431783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e7e6f-9f04-4e48-a8ea-4f475708d14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:11.432347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e7e6f-9f04-4e48-a8ea-4f475708d14a admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:11.433104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e7e6f-9f04-4e48-a8ea-4f475708d14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:11.435351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e7e6f-9f04-4e48-a8ea-4f475708d14a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:11.443038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1315/2678] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:11.470360 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27713fc7-1815-4f15-9266-252a08e9f8ed None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:11.470672 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1364/2679] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:11 2022] POST /identity/v3/users => generated 297 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:11.473754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-27713fc7-1815-4f15-9266-252a08e9f8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:11.477740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e7e6f-9f04-4e48-a8ea-4f475708d14a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:11.516394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e7e6f-9f04-4e48-a8ea-4f475708d14a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:11.528470 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18fb33-472d-42ec-aab4-32fcb3407a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:11.530390 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18fb33-472d-42ec-aab4-32fcb3407a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:11.531308 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18fb33-472d-42ec-aab4-32fcb3407a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:11.531964 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18fb33-472d-42ec-aab4-32fcb3407a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:11.534196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18fb33-472d-42ec-aab4-32fcb3407a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:11.537926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18fb33-472d-42ec-aab4-32fcb3407a91 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:11.570291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1365/2680] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:11.572358 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18fb33-472d-42ec-aab4-32fcb3407a91 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:11.596533 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18fb33-472d-42ec-aab4-32fcb3407a91 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:11.607345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adec05-b8fa-4463-afab-382af8025ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:11.608449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adec05-b8fa-4463-afab-382af8025ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:11.608854 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adec05-b8fa-4463-afab-382af8025ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:11.609233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adec05-b8fa-4463-afab-382af8025ad1 admin admin] PATH_INFO: `/v3/projects/580774d146f74c0ebfc8e57d639d389f/users/5fa8d250125d4ecfacc6c09628e0efed/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:11.629508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adec05-b8fa-4463-afab-382af8025ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580774d146f74c0ebfc8e57d639d389f, user_id=5fa8d250125d4ecfacc6c09628e0efed, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:11.634700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adec05-b8fa-4463-afab-382af8025ad1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:11.639798 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27713fc7-1815-4f15-9266-252a08e9f8ed None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:11.650896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf6820-8596-4a94-9fe5-a12c7c708429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:11.655733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf6820-8596-4a94-9fe5-a12c7c708429 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:11.656488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf6820-8596-4a94-9fe5-a12c7c708429 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:11.657696 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf6820-8596-4a94-9fe5-a12c7c708429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:11.664688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1366/2681] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:11 2022] PUT /identity/v3/projects/580774d146f74c0ebfc8e57d639d389f/users/5fa8d250125d4ecfacc6c09628e0efed/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:11.672857 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adec05-b8fa-4463-afab-382af8025ad1 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:11.679467 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf6820-8596-4a94-9fe5-a12c7c708429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:11.684567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf6820-8596-4a94-9fe5-a12c7c708429 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:11.700090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1316/2682] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:11 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:11.787939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:11.831068 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf6820-8596-4a94-9fe5-a12c7c708429 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:11.845510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adec05-b8fa-4463-afab-382af8025ad1 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:11.851699 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1e046-06c6-4dc9-9c9a-addd45cc4a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:11.852769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e046-06c6-4dc9-9c9a-addd45cc4a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:11.853594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e046-06c6-4dc9-9c9a-addd45cc4a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:11.854997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e046-06c6-4dc9-9c9a-addd45cc4a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:11.856029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf6820-8596-4a94-9fe5-a12c7c708429 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:11.856302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1e046-06c6-4dc9-9c9a-addd45cc4a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:11.858856 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1e046-06c6-4dc9-9c9a-addd45cc4a02 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:11.880779 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1367/2683] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:11.882112 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1e046-06c6-4dc9-9c9a-addd45cc4a02 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:11.899475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1e046-06c6-4dc9-9c9a-addd45cc4a02 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:11.905787 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291b85f-0795-42a9-b323-98c4064c67a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:11.907766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291b85f-0795-42a9-b323-98c4064c67a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:11.908158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291b85f-0795-42a9-b323-98c4064c67a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:11.908550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291b85f-0795-42a9-b323-98c4064c67a1 admin admin] PATH_INFO: `/v3/projects/580774d146f74c0ebfc8e57d639d389f/users/5fa8d250125d4ecfacc6c09628e0efed/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:11.911026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291b85f-0795-42a9-b323-98c4064c67a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580774d146f74c0ebfc8e57d639d389f, user_id=5fa8d250125d4ecfacc6c09628e0efed, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:11.914027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291b85f-0795-42a9-b323-98c4064c67a1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:11.952530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1368/2684] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:11 2022] PUT /identity/v3/projects/580774d146f74c0ebfc8e57d639d389f/users/5fa8d250125d4ecfacc6c09628e0efed/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:11.954721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf0ce-7c9c-4103-8843-c34b6a3f1615 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:11.955141 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf0ce-7c9c-4103-8843-c34b6a3f1615 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:11.955569 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf0ce-7c9c-4103-8843-c34b6a3f1615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:12.015365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a53bf0ce-7c9c-4103-8843-c34b6a3f1615 None None] MFA Rules not processed for user `5fa8d250125d4ecfacc6c09628e0efed`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:12.017238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a53bf0ce-7c9c-4103-8843-c34b6a3f1615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:12.030456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e445b2c-4d0b-4e3f-afad-be856345c3c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:12.031732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445b2c-4d0b-4e3f-afad-be856345c3c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:12.032096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445b2c-4d0b-4e3f-afad-be856345c3c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:12.032582 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445b2c-4d0b-4e3f-afad-be856345c3c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:12.201477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1369/2685] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:12.205287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e445b2c-4d0b-4e3f-afad-be856345c3c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:12.209368 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e445b2c-4d0b-4e3f-afad-be856345c3c9 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:12.228301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bf0ce-7c9c-4103-8843-c34b6a3f1615 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:12.234657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a53bf0ce-7c9c-4103-8843-c34b6a3f1615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:12.245508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1317/2686] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:11 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:12.371355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bf0ce-7c9c-4103-8843-c34b6a3f1615 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:12.379879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232060cb-e493-4a96-87ad-6bbe4577201d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:12.381020 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232060cb-e493-4a96-87ad-6bbe4577201d service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:12.381686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232060cb-e493-4a96-87ad-6bbe4577201d service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:12.382146 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232060cb-e493-4a96-87ad-6bbe4577201d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:12.404113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232060cb-e493-4a96-87ad-6bbe4577201d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:12.406104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232060cb-e493-4a96-87ad-6bbe4577201d service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:12.420086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1370/2687] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:12.598533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e445b2c-4d0b-4e3f-afad-be856345c3c9 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:12.607784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:12.612306 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e445b2c-4d0b-4e3f-afad-be856345c3c9 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:12.617562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a1224-e13c-4a5c-8b11-34204b3c9779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:12.618333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a1224-e13c-4a5c-8b11-34204b3c9779 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:12.618733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a1224-e13c-4a5c-8b11-34204b3c9779 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:12.619070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a1224-e13c-4a5c-8b11-34204b3c9779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:12.739479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a1224-e13c-4a5c-8b11-34204b3c9779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:12.742931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a1224-e13c-4a5c-8b11-34204b3c9779 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:12.772240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1318/2688] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:22.413891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:22.756289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=26 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:23.031808 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec5cb1-5d31-483d-8d1d-ae44e126bc9f None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:23.032103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec5cb1-5d31-483d-8d1d-ae44e126bc9f None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:23.032388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec5cb1-5d31-483d-8d1d-ae44e126bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:23.053585 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-57ec5cb1-5d31-483d-8d1d-ae44e126bc9f None None] MFA Rules not processed for user `172df9a596fd4729967f3787533ea57d`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:23.054930 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-57ec5cb1-5d31-483d-8d1d-ae44e126bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:23.137561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1371/2689] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:23.445705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a1224-e13c-4a5c-8b11-34204b3c9779 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:23.447262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-563a1224-e13c-4a5c-8b11-34204b3c9779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:23.555840 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a1224-e13c-4a5c-8b11-34204b3c9779 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:23.561864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4782ef-43f2-4304-812f-0beaee2bcd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:23.561864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4782ef-43f2-4304-812f-0beaee2bcd03 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:23.561864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4782ef-43f2-4304-812f-0beaee2bcd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:23.561864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4782ef-43f2-4304-812f-0beaee2bcd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:23.564258 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-da4782ef-43f2-4304-812f-0beaee2bcd03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:23.577263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4782ef-43f2-4304-812f-0beaee2bcd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:23.578825 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4782ef-43f2-4304-812f-0beaee2bcd03 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:23.589263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1319/2690] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:24.543175 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec5cb1-5d31-483d-8d1d-ae44e126bc9f None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:24.560336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec5cb1-5d31-483d-8d1d-ae44e126bc9f None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:24.566025 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ba760-e90b-47c5-866b-bb42d159c0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:24.567512 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ba760-e90b-47c5-866b-bb42d159c0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:24.568018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ba760-e90b-47c5-866b-bb42d159c0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:24.568529 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ba760-e90b-47c5-866b-bb42d159c0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:24.573162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c78ba760-e90b-47c5-866b-bb42d159c0c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:24.680387 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ba760-e90b-47c5-866b-bb42d159c0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:24.681980 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ba760-e90b-47c5-866b-bb42d159c0c2 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:24.696426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1372/2691] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:25.096719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4782ef-43f2-4304-812f-0beaee2bcd03 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:25.121489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4782ef-43f2-4304-812f-0beaee2bcd03 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:25.133108 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:25.134716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:25.135198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:25.136508 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] PATH_INFO: `/v3/users/95a0ce215c694563b419863e77e2269d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:25.139243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a0ce215c694563b419863e77e2269d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:25.143566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:25.251602 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a0ce215c694563b419863e77e2269d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:25.292617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a0ce215c694563b419863e77e2269d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:25.303114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a0ce215c694563b419863e77e2269d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:25.335439 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a0ce215c694563b419863e77e2269d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:25.353360 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a0ce215c694563b419863e77e2269d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:25.362676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1320/2692] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:25 2022] DELETE /identity/v3/users/95a0ce215c694563b419863e77e2269d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:25.367291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d81ead-dedd-422d-b924-cbe26fb7c74d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:25.368023 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d81ead-dedd-422d-b924-cbe26fb7c74d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:25.368475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d81ead-dedd-422d-b924-cbe26fb7c74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:25.407860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-22d81ead-dedd-422d-b924-cbe26fb7c74d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:25.409542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-22d81ead-dedd-422d-b924-cbe26fb7c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:25.510644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1373/2693] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:25.543425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:25.547351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:25.589528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f77a7-22b5-4451-b8f5-ae6d4f1fbd35 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:25.590486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f77a7-22b5-4451-b8f5-ae6d4f1fbd35 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:25.590486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f77a7-22b5-4451-b8f5-ae6d4f1fbd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:25.636485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-3a0f77a7-22b5-4451-b8f5-ae6d4f1fbd35 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:25.638270 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3a0f77a7-22b5-4451-b8f5-ae6d4f1fbd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:25.677689 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:25.692323 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f8b62-970e-4e7c-8134-29f11d6b8473 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:25.696536 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15184b-23da-4828-85bb-6afc8250fe51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:25.697430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15184b-23da-4828-85bb-6afc8250fe51 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:25.697860 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15184b-23da-4828-85bb-6afc8250fe51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:25.698297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15184b-23da-4828-85bb-6afc8250fe51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:25.709215 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15184b-23da-4828-85bb-6afc8250fe51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:25.711034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15184b-23da-4828-85bb-6afc8250fe51 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:25.716020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:25.728114 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1321/2694] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:25.746705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1374/2695] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:25.765767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15184b-23da-4828-85bb-6afc8250fe51 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:25.768070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dc15184b-23da-4828-85bb-6afc8250fe51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:25.881657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15184b-23da-4828-85bb-6afc8250fe51 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:25.888122 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b7699-0b50-4904-9b07-d57a24ea2033 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:25.889627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b7699-0b50-4904-9b07-d57a24ea2033 service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:25.889627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b7699-0b50-4904-9b07-d57a24ea2033 service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:25.889627 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b7699-0b50-4904-9b07-d57a24ea2033 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:25.911932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b7699-0b50-4904-9b07-d57a24ea2033 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:25.913801 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b7699-0b50-4904-9b07-d57a24ea2033 service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:25.927286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1322/2696] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:33:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:33:26.989317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f77a7-22b5-4451-b8f5-ae6d4f1fbd35 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:26.991750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3a0f77a7-22b5-4451-b8f5-ae6d4f1fbd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:27.050717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f77a7-22b5-4451-b8f5-ae6d4f1fbd35 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:27.071939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:27.074011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:27.074863 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:27.075667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] PATH_INFO: `/v3/projects/c21821c1aa3142738d9b8fc10517f490` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:27.083030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21821c1aa3142738d9b8fc10517f490)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:27.093879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:27.275124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21821c1aa3142738d9b8fc10517f490', 'request_id': 'req-9c4c80df-5f3f-4736-bf27-e35171608a06'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:27.299780 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21821c1aa3142738d9b8fc10517f490', 'request_id': 'req-9c4c80df-5f3f-4736-bf27-e35171608a06'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:27.312861 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21821c1aa3142738d9b8fc10517f490', 'request_id': 'req-9c4c80df-5f3f-4736-bf27-e35171608a06'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:27.352262 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] The token cache is being invalidate because project c21821c1aa3142738d9b8fc10517f490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:27.355284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:27.357919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:27.361881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1375/2697] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:26 2022] DELETE /identity/v3/projects/c21821c1aa3142738d9b8fc10517f490 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:27.368096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b7699-0b50-4904-9b07-d57a24ea2033 service swift] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:27.407156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b7699-0b50-4904-9b07-d57a24ea2033 service swift] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:27.544598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:27.546861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:27.547876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:27.549089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] PATH_INFO: `/v3/users/5fa8d250125d4ecfacc6c09628e0efed` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:27.552249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa8d250125d4ecfacc6c09628e0efed)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:27.556591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:27.698472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa8d250125d4ecfacc6c09628e0efed'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:27.757686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa8d250125d4ecfacc6c09628e0efed'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:27.759731 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa8d250125d4ecfacc6c09628e0efed'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:27.851783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa8d250125d4ecfacc6c09628e0efed'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:27.903905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5476cd38-fb0b-4da9-a1ff-2794852beed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa8d250125d4ecfacc6c09628e0efed'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:27.926676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1323/2698] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:27 2022] DELETE /identity/v3/users/5fa8d250125d4ecfacc6c09628e0efed => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:29.808989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:29.811611 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:29.886473 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c80df-5f3f-4736-bf27-e35171608a06 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:30.160140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:30.162393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:30.163291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:30.165864 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] PATH_INFO: `/v3/projects/580774d146f74c0ebfc8e57d639d389f` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:30.187063 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=580774d146f74c0ebfc8e57d639d389f)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:30.194055 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:30.413399 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580774d146f74c0ebfc8e57d639d389f', 'request_id': 'req-63fe52d0-9340-4250-9e35-4ab82b7734fe'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:30.447086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580774d146f74c0ebfc8e57d639d389f', 'request_id': 'req-63fe52d0-9340-4250-9e35-4ab82b7734fe'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:30.470088 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580774d146f74c0ebfc8e57d639d389f', 'request_id': 'req-63fe52d0-9340-4250-9e35-4ab82b7734fe'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:30.472675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:30.505097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] The token cache is being invalidate because project 580774d146f74c0ebfc8e57d639d389f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:30.505627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:30.510995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-63fe52d0-9340-4250-9e35-4ab82b7734fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:30.530865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1376/2699] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:29 2022] DELETE /identity/v3/projects/580774d146f74c0ebfc8e57d639d389f => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:30.536621 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf103c-7c76-4943-bf34-35bf0d0161a2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:30.537510 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf103c-7c76-4943-bf34-35bf0d0161a2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:30.537855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf103c-7c76-4943-bf34-35bf0d0161a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:30.570378 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:30.694464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-cfdf103c-7c76-4943-bf34-35bf0d0161a2 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:30.701399 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cfdf103c-7c76-4943-bf34-35bf0d0161a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:30.863709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1324/2700] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:30.879288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b10d9-6ce7-46af-a5af-1805875152d4 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:30.879999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b10d9-6ce7-46af-a5af-1805875152d4 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:30.880349 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b10d9-6ce7-46af-a5af-1805875152d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:30.933891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-040b10d9-6ce7-46af-a5af-1805875152d4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:30.935357 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-040b10d9-6ce7-46af-a5af-1805875152d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:30.983800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf103c-7c76-4943-bf34-35bf0d0161a2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:30.995002 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1377/2701] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:31.013240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf103c-7c76-4943-bf34-35bf0d0161a2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:31.070602 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3786d-255e-437a-835a-82e0db1e940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:31.071905 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3786d-255e-437a-835a-82e0db1e940b admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:31.074729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3786d-255e-437a-835a-82e0db1e940b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:31.075293 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3786d-255e-437a-835a-82e0db1e940b admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:31.079675 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3786d-255e-437a-835a-82e0db1e940b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:33:31.080242 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3786d-255e-437a-835a-82e0db1e940b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:31.086436 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3786d-255e-437a-835a-82e0db1e940b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:31.143418 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b10d9-6ce7-46af-a5af-1805875152d4 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:31.152189 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1325/2702] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:33:31.175651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b10d9-6ce7-46af-a5af-1805875152d4 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:31.200097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb899-027b-4870-9e78-ccdc02696c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:31.203400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb899-027b-4870-9e78-ccdc02696c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:31.204055 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb899-027b-4870-9e78-ccdc02696c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:31.204486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb899-027b-4870-9e78-ccdc02696c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:31.205366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fb899-027b-4870-9e78-ccdc02696c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:31.209589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fb899-027b-4870-9e78-ccdc02696c98 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:31.318608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1378/2703] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:31 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:31.330351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3786d-255e-437a-835a-82e0db1e940b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:31.363359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3786d-255e-437a-835a-82e0db1e940b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:31.635471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11457856-10d8-4667-85ce-8aca73c7e2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:31.639433 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11457856-10d8-4667-85ce-8aca73c7e2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:31.643155 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11457856-10d8-4667-85ce-8aca73c7e2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:31.645681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11457856-10d8-4667-85ce-8aca73c7e2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:31.645681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11457856-10d8-4667-85ce-8aca73c7e2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:31.648420 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11457856-10d8-4667-85ce-8aca73c7e2d8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:31.704715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1326/2704] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:31 2022] POST /identity/v3/users => generated 294 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:31.706767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb899-027b-4870-9e78-ccdc02696c98 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:31.731944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb899-027b-4870-9e78-ccdc02696c98 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:31.742009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1f94c-a472-456f-a78a-26aebb143f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:31.743340 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f94c-a472-456f-a78a-26aebb143f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:31.743935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f94c-a472-456f-a78a-26aebb143f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:31.744811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f94c-a472-456f-a78a-26aebb143f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:31.746329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1f94c-a472-456f-a78a-26aebb143f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:31.749887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1f94c-a472-456f-a78a-26aebb143f3f admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:31.789363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1379/2705] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:31.795545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11457856-10d8-4667-85ce-8aca73c7e2d8 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:31.825541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11457856-10d8-4667-85ce-8aca73c7e2d8 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:31.834142 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99d775-7a0d-4f64-b6c4-7d583cd7e4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:31.835354 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99d775-7a0d-4f64-b6c4-7d583cd7e4da admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:31.835817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99d775-7a0d-4f64-b6c4-7d583cd7e4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:31.836302 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99d775-7a0d-4f64-b6c4-7d583cd7e4da admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:31.837702 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99d775-7a0d-4f64-b6c4-7d583cd7e4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:31.840904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99d775-7a0d-4f64-b6c4-7d583cd7e4da admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:31.909944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1327/2706] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:31.914878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1f94c-a472-456f-a78a-26aebb143f3f admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:31.942974 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1f94c-a472-456f-a78a-26aebb143f3f admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:31.956789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73a438-e08c-4262-9894-957f6f8fe9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:31.958822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73a438-e08c-4262-9894-957f6f8fe9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:31.963016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73a438-e08c-4262-9894-957f6f8fe9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:31.963898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73a438-e08c-4262-9894-957f6f8fe9f7 admin admin] PATH_INFO: `/v3/projects/0840bcb320674a16862ba8647fe98b87/users/b1caf99710034e0097eb08432b0a34f2/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:32.052524 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73a438-e08c-4262-9894-957f6f8fe9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0840bcb320674a16862ba8647fe98b87, user_id=b1caf99710034e0097eb08432b0a34f2, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:32.059984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73a438-e08c-4262-9894-957f6f8fe9f7 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:32.109826 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1380/2707] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:31 2022] PUT /identity/v3/projects/0840bcb320674a16862ba8647fe98b87/users/b1caf99710034e0097eb08432b0a34f2/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:32.131939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141266f-4d84-417c-b424-0b6108486051 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:32.132318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141266f-4d84-417c-b424-0b6108486051 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:32.132606 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141266f-4d84-417c-b424-0b6108486051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:32.228356 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a141266f-4d84-417c-b424-0b6108486051 None None] MFA Rules not processed for user `b1caf99710034e0097eb08432b0a34f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:32.242134 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a141266f-4d84-417c-b424-0b6108486051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:32.423171 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:32.578262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1328/2708] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:32.584455 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73a438-e08c-4262-9894-957f6f8fe9f7 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:32.793954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73a438-e08c-4262-9894-957f6f8fe9f7 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:32.799693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab86e4-4233-41a9-b7cf-3664b4169c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:32.800624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab86e4-4233-41a9-b7cf-3664b4169c74 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:32.800917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab86e4-4233-41a9-b7cf-3664b4169c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:32.801201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab86e4-4233-41a9-b7cf-3664b4169c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:32.802430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab86e4-4233-41a9-b7cf-3664b4169c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:32.805200 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab86e4-4233-41a9-b7cf-3664b4169c74 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:32.874103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1381/2709] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:32 2022] POST /identity/v3/projects => generated 387 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:32.876828 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141266f-4d84-417c-b424-0b6108486051 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:32.892728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141266f-4d84-417c-b424-0b6108486051 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:33.120555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14629d-ed3d-441b-9e7a-d8e6e9dad91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:33.122182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14629d-ed3d-441b-9e7a-d8e6e9dad91b admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:33.124513 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14629d-ed3d-441b-9e7a-d8e6e9dad91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:33.125253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14629d-ed3d-441b-9e7a-d8e6e9dad91b admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:33.127198 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14629d-ed3d-441b-9e7a-d8e6e9dad91b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:33.156806 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14629d-ed3d-441b-9e7a-d8e6e9dad91b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:33.238475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1329/2710] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:32 2022] POST /identity/v3/users => generated 300 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:33.238754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab86e4-4233-41a9-b7cf-3664b4169c74 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:33.278406 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab86e4-4233-41a9-b7cf-3664b4169c74 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:33.307028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf0419-e7ab-4e1a-8806-9aa95d129f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:33.312774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf0419-e7ab-4e1a-8806-9aa95d129f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:33.312774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf0419-e7ab-4e1a-8806-9aa95d129f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:33.320067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf0419-e7ab-4e1a-8806-9aa95d129f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:33.326905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf0419-e7ab-4e1a-8806-9aa95d129f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:33.350030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf0419-e7ab-4e1a-8806-9aa95d129f9b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:33.378131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1382/2711] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:33:33.384720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14629d-ed3d-441b-9e7a-d8e6e9dad91b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:33.423196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14629d-ed3d-441b-9e7a-d8e6e9dad91b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:33.453646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4787bb-a9b3-42e3-933d-aebd803d67e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:33.454668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4787bb-a9b3-42e3-933d-aebd803d67e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:33.454990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4787bb-a9b3-42e3-933d-aebd803d67e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:33.455191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4787bb-a9b3-42e3-933d-aebd803d67e2 admin admin] PATH_INFO: `/v3/projects/439e9e085e5e44db8ecce4d9152d8d87/users/0de1f04aa8654b638008fdfd0d018c4f/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:33.512167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4787bb-a9b3-42e3-933d-aebd803d67e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=439e9e085e5e44db8ecce4d9152d8d87, user_id=0de1f04aa8654b638008fdfd0d018c4f, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:33.521522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4787bb-a9b3-42e3-933d-aebd803d67e2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:33.580743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1330/2712] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:33 2022] PUT /identity/v3/projects/439e9e085e5e44db8ecce4d9152d8d87/users/0de1f04aa8654b638008fdfd0d018c4f/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:33.586196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf0419-e7ab-4e1a-8806-9aa95d129f9b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:33.607389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf0419-e7ab-4e1a-8806-9aa95d129f9b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:33.654144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4787bb-a9b3-42e3-933d-aebd803d67e2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:33.656775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0e4787bb-a9b3-42e3-933d-aebd803d67e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:33.870553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b0c48-e0ad-4d03-9dd0-4d7554887073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:33.871990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b0c48-e0ad-4d03-9dd0-4d7554887073 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:33.872305 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b0c48-e0ad-4d03-9dd0-4d7554887073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:33.872587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b0c48-e0ad-4d03-9dd0-4d7554887073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:33.873726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b0c48-e0ad-4d03-9dd0-4d7554887073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:33.878419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b0c48-e0ad-4d03-9dd0-4d7554887073 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:33.887478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:33.925026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1383/2713] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:33.931595 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b0c48-e0ad-4d03-9dd0-4d7554887073 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:33.958617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b0c48-e0ad-4d03-9dd0-4d7554887073 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:33.967367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87602231-9bcb-4b72-a1d2-3addf433d681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:33.968311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602231-9bcb-4b72-a1d2-3addf433d681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:33.968586 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602231-9bcb-4b72-a1d2-3addf433d681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:33.968876 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602231-9bcb-4b72-a1d2-3addf433d681 admin admin] PATH_INFO: `/v3/projects/439e9e085e5e44db8ecce4d9152d8d87/users/0de1f04aa8654b638008fdfd0d018c4f/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:33.972144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87602231-9bcb-4b72-a1d2-3addf433d681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=439e9e085e5e44db8ecce4d9152d8d87, user_id=0de1f04aa8654b638008fdfd0d018c4f, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:33.975031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87602231-9bcb-4b72-a1d2-3addf433d681 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:34.018644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1384/2714] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:33 2022] PUT /identity/v3/projects/439e9e085e5e44db8ecce4d9152d8d87/users/0de1f04aa8654b638008fdfd0d018c4f/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:34.020935 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4943d01-8d23-4aa0-a188-1f7b4931ddee None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:34.021202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4943d01-8d23-4aa0-a188-1f7b4931ddee None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:34.021490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4943d01-8d23-4aa0-a188-1f7b4931ddee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:34.033162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4787bb-a9b3-42e3-933d-aebd803d67e2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:34.086286 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-c4943d01-8d23-4aa0-a188-1f7b4931ddee None None] MFA Rules not processed for user `0de1f04aa8654b638008fdfd0d018c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:34.088024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c4943d01-8d23-4aa0-a188-1f7b4931ddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:34.155475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:34.184614 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:34.185755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:34.185924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:34.186213 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] PATH_INFO: `/v3/users/87b5a8a8dc544c449faa689517fb798e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:34.203850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b5a8a8dc544c449faa689517fb798e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:34.206254 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:34.296795 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1385/2715] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:34.320769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4943d01-8d23-4aa0-a188-1f7b4931ddee None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:34.323463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c4943d01-8d23-4aa0-a188-1f7b4931ddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:34.361049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b5a8a8dc544c449faa689517fb798e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:34.383097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b5a8a8dc544c449faa689517fb798e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:34.385286 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b5a8a8dc544c449faa689517fb798e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:34.443188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b5a8a8dc544c449faa689517fb798e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:34.490709 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-92451692-8411-409c-9a85-7342a9297b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b5a8a8dc544c449faa689517fb798e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:34.512842 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1331/2716] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:33 2022] DELETE /identity/v3/users/87b5a8a8dc544c449faa689517fb798e => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:34.519853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a831-abcb-4436-9d34-08e88efaabd4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:34.520690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a831-abcb-4436-9d34-08e88efaabd4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:34.521373 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a831-abcb-4436-9d34-08e88efaabd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:34.552488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4943d01-8d23-4aa0-a188-1f7b4931ddee None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:34.563880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6ec1a831-abcb-4436-9d34-08e88efaabd4 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:34.567560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6ec1a831-abcb-4436-9d34-08e88efaabd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:34.732407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b70372-cfa5-416d-9148-20cce479cc79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:34.734000 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b70372-cfa5-416d-9148-20cce479cc79 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:34.734805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b70372-cfa5-416d-9148-20cce479cc79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:34.736320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b70372-cfa5-416d-9148-20cce479cc79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:34.742898 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d4b70372-cfa5-416d-9148-20cce479cc79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:34.785477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1332/2717] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:34.797116 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1a831-abcb-4436-9d34-08e88efaabd4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:34.800329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6ec1a831-abcb-4436-9d34-08e88efaabd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:34.868926 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:34.872778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1a831-abcb-4436-9d34-08e88efaabd4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:34.883740 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9db17-e2b9-472e-8510-9cc2f0332f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:34.884494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9db17-e2b9-472e-8510-9cc2f0332f88 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:34.885133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9db17-e2b9-472e-8510-9cc2f0332f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:34.888533 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9db17-e2b9-472e-8510-9cc2f0332f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:34.907334 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9db17-e2b9-472e-8510-9cc2f0332f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:34.908703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9db17-e2b9-472e-8510-9cc2f0332f88 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:34.926314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b70372-cfa5-416d-9148-20cce479cc79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:34.927948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b70372-cfa5-416d-9148-20cce479cc79 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:34.937995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1333/2718] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:34.945015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1386/2719] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:35.062771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9db17-e2b9-472e-8510-9cc2f0332f88 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:35.065290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-82f9db17-e2b9-472e-8510-9cc2f0332f88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:35.112517 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9db17-e2b9-472e-8510-9cc2f0332f88 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:35.140082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:35.146715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:35.147405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:35.148438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] PATH_INFO: `/v3/users/b1caf99710034e0097eb08432b0a34f2` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:35.159436 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1caf99710034e0097eb08432b0a34f2)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:35.164001 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:35.182357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:35.335899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1caf99710034e0097eb08432b0a34f2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:35.361871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1caf99710034e0097eb08432b0a34f2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:35.364719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1caf99710034e0097eb08432b0a34f2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:35.419952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1caf99710034e0097eb08432b0a34f2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:35.437953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1caf99710034e0097eb08432b0a34f2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:35.463865 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1334/2720] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:35 2022] DELETE /identity/v3/users/b1caf99710034e0097eb08432b0a34f2 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:35.464477 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f79cc-5d9d-4f60-834e-301c6964f936 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:35.464967 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f79cc-5d9d-4f60-834e-301c6964f936 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:35.465288 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f79cc-5d9d-4f60-834e-301c6964f936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:35.504217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-f83f79cc-5d9d-4f60-834e-301c6964f936 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:35.506034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f83f79cc-5d9d-4f60-834e-301c6964f936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:35.673726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1387/2721] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:35.691716 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:35.697049 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:35.857100 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f79cc-5d9d-4f60-834e-301c6964f936 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:35.861664 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70915fc7-c6ce-40a1-b7f5-043a60e7de27 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:35.867004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f83f79cc-5d9d-4f60-834e-301c6964f936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:35.871005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d17f81-d65c-4493-b322-16c3864b4857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:35.873100 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d17f81-d65c-4493-b322-16c3864b4857 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:35.874067 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d17f81-d65c-4493-b322-16c3864b4857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:35.874896 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d17f81-d65c-4493-b322-16c3864b4857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:35.909587 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f79cc-5d9d-4f60-834e-301c6964f936 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:35.911895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d17f81-d65c-4493-b322-16c3864b4857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:35.915873 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d17f81-d65c-4493-b322-16c3864b4857 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:35.932673 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:35.934244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:35.934800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:35.935291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] PATH_INFO: `/v3/projects/a6a39f5ab6904afd99f72c94ef68098b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:35.944206 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a39f5ab6904afd99f72c94ef68098b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:35.954705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:35.955656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1335/2722] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:36.160400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a39f5ab6904afd99f72c94ef68098b', 'request_id': 'req-c694af75-0bcc-43da-bb42-d1ed981cd27d'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:36.187576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a39f5ab6904afd99f72c94ef68098b', 'request_id': 'req-c694af75-0bcc-43da-bb42-d1ed981cd27d'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:36.220396 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a39f5ab6904afd99f72c94ef68098b', 'request_id': 'req-c694af75-0bcc-43da-bb42-d1ed981cd27d'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:36.253397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] The token cache is being invalidate because project a6a39f5ab6904afd99f72c94ef68098b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:36.253397 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:36.254551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:36.257507 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1388/2723] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:35 2022] DELETE /identity/v3/projects/a6a39f5ab6904afd99f72c94ef68098b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:36.264528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d17f81-d65c-4493-b322-16c3864b4857 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:36.306478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d17f81-d65c-4493-b322-16c3864b4857 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:36.507514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:36.509502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:36.510006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:36.510473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] PATH_INFO: `/v3/users/e1a17d5d22ca44869ed9a92b4216830d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:36.514719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a17d5d22ca44869ed9a92b4216830d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:36.521214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:36.633818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:36.722010 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a17d5d22ca44869ed9a92b4216830d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:36.752993 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a17d5d22ca44869ed9a92b4216830d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:36.754248 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a17d5d22ca44869ed9a92b4216830d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:36.803063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a17d5d22ca44869ed9a92b4216830d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:36.823524 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a17d5d22ca44869ed9a92b4216830d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:36.841912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1336/2724] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:36 2022] DELETE /identity/v3/users/e1a17d5d22ca44869ed9a92b4216830d => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:36.891373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:36.893999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:36.935717 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694af75-0bcc-43da-bb42-d1ed981cd27d admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:37.233807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:37.235580 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:37.236232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:37.248737 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] PATH_INFO: `/v3/projects/0840bcb320674a16862ba8647fe98b87` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:37.251906 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0840bcb320674a16862ba8647fe98b87)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:37.256490 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:37.261446 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:37.432766 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0840bcb320674a16862ba8647fe98b87', 'request_id': 'req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:37.465747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0840bcb320674a16862ba8647fe98b87', 'request_id': 'req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:37.483474 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0840bcb320674a16862ba8647fe98b87', 'request_id': 'req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:37.520518 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] The token cache is being invalidate because project 0840bcb320674a16862ba8647fe98b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:37.525911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:37.527797 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:37.532542 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1389/2725] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:36 2022] DELETE /identity/v3/projects/0840bcb320674a16862ba8647fe98b87 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:37.537591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:37.540599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:37.597719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3be90-a26a-4fe6-aed6-0bca29eaf2da admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:37.702552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:37.704685 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:37.816853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:37.819927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:37.819927 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:37.820237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] PATH_INFO: `/v3/users/0de1f04aa8654b638008fdfd0d018c4f` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:37.822827 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de1f04aa8654b638008fdfd0d018c4f)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:37.828694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:37.991784 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de1f04aa8654b638008fdfd0d018c4f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.015096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de1f04aa8654b638008fdfd0d018c4f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.016932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de1f04aa8654b638008fdfd0d018c4f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.036140 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee9cf2-6db9-4aa5-8529-712d3e09f00b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:38.054046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de1f04aa8654b638008fdfd0d018c4f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.056657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:38.058119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.058460 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.058783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] PATH_INFO: `/v3/projects/19fc9f4270b4402cae15062b92ebb7d6` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.062921 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19fc9f4270b4402cae15062b92ebb7d6)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:38.064959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:38.092281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6642d87c-3def-4015-b003-f20ad606a2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de1f04aa8654b638008fdfd0d018c4f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.101629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1337/2726] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:37 2022] DELETE /identity/v3/users/0de1f04aa8654b638008fdfd0d018c4f => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:38.176278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19fc9f4270b4402cae15062b92ebb7d6', 'request_id': 'req-454a4ab7-7daa-4375-9545-afe05f3e3d02'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.195143 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19fc9f4270b4402cae15062b92ebb7d6', 'request_id': 'req-454a4ab7-7daa-4375-9545-afe05f3e3d02'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.211430 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19fc9f4270b4402cae15062b92ebb7d6', 'request_id': 'req-454a4ab7-7daa-4375-9545-afe05f3e3d02'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.227066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] The token cache is being invalidate because project 19fc9f4270b4402cae15062b92ebb7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:38.227351 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.228419 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-454a4ab7-7daa-4375-9545-afe05f3e3d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.231588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1390/2727] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:37 2022] DELETE /identity/v3/projects/19fc9f4270b4402cae15062b92ebb7d6 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:38.237698 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80dc13-e897-427e-929b-d06d7d03e79c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.238426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80dc13-e897-427e-929b-d06d7d03e79c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.238947 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80dc13-e897-427e-929b-d06d7d03e79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.269435 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1a80dc13-e897-427e-929b-d06d7d03e79c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:38.273037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1a80dc13-e897-427e-929b-d06d7d03e79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:38.313646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:38.404602 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1338/2728] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:38.417449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8796f1-e96b-480c-b128-87af778054e0 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.418796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8796f1-e96b-480c-b128-87af778054e0 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.418796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8796f1-e96b-480c-b128-87af778054e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.440732 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-de8796f1-e96b-480c-b128-87af778054e0 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:38.442027 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-de8796f1-e96b-480c-b128-87af778054e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:38.451881 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1391/2729] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:38.456348 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80dc13-e897-427e-929b-d06d7d03e79c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:38.468174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80dc13-e897-427e-929b-d06d7d03e79c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:38.473856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e5a15-dc9e-47e5-b002-fed7f059ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:38.474742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e5a15-dc9e-47e5-b002-fed7f059ffa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.475834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e5a15-dc9e-47e5-b002-fed7f059ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.475834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e5a15-dc9e-47e5-b002-fed7f059ffa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.476426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e5a15-dc9e-47e5-b002-fed7f059ffa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:33:38.476844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e5a15-dc9e-47e5-b002-fed7f059ffa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:38.478700 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e5a15-dc9e-47e5-b002-fed7f059ffa8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:38.496080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1339/2730] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:33:38.501122 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8796f1-e96b-480c-b128-87af778054e0 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:38.512944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8796f1-e96b-480c-b128-87af778054e0 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:38.519123 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b795b-10f9-45d7-bebc-27850f550b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:38.520024 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b795b-10f9-45d7-bebc-27850f550b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.520316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b795b-10f9-45d7-bebc-27850f550b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.520602 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b795b-10f9-45d7-bebc-27850f550b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.521421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b795b-10f9-45d7-bebc-27850f550b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:38.523540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b795b-10f9-45d7-bebc-27850f550b58 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:38.539540 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e5a15-dc9e-47e5-b002-fed7f059ffa8 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:38.543018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:38.548299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-412e5a15-dc9e-47e5-b002-fed7f059ffa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:38.566438 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e5a15-dc9e-47e5-b002-fed7f059ffa8 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:38.576037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:38.576383 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1392/2731] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:38 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:38.577323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b795b-10f9-45d7-bebc-27850f550b58 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:38.578791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.579560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.579847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] PATH_INFO: `/v3/projects/439e9e085e5e44db8ecce4d9152d8d87` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.582949 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] RBAC: Authorizing `identity:delete_project(project_id=439e9e085e5e44db8ecce4d9152d8d87)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:38.585273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:38.679739 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b795b-10f9-45d7-bebc-27850f550b58 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:38.683527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439e9e085e5e44db8ecce4d9152d8d87', 'request_id': 'req-478bbd39-b655-4b58-899e-ee9c322e09de'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.699221 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439e9e085e5e44db8ecce4d9152d8d87', 'request_id': 'req-478bbd39-b655-4b58-899e-ee9c322e09de'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.721683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439e9e085e5e44db8ecce4d9152d8d87', 'request_id': 'req-478bbd39-b655-4b58-899e-ee9c322e09de'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.749417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] The token cache is being invalidate because project 439e9e085e5e44db8ecce4d9152d8d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:38.749816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.750447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-478bbd39-b655-4b58-899e-ee9c322e09de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:38.752818 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1340/2732] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:38 2022] DELETE /identity/v3/projects/439e9e085e5e44db8ecce4d9152d8d87 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:38.759637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a559c-60d0-49e4-b0e6-22e11290c9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:38.760504 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a559c-60d0-49e4-b0e6-22e11290c9cb admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.760904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a559c-60d0-49e4-b0e6-22e11290c9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.761291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a559c-60d0-49e4-b0e6-22e11290c9cb admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.762535 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a559c-60d0-49e4-b0e6-22e11290c9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:38.765008 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a559c-60d0-49e4-b0e6-22e11290c9cb admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:38.769516 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0c89b-1084-4ed7-bcc8-cf1314ee14c5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.770026 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0c89b-1084-4ed7-bcc8-cf1314ee14c5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.770733 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0c89b-1084-4ed7-bcc8-cf1314ee14c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.796810 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a1d0c89b-1084-4ed7-bcc8-cf1314ee14c5 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:38.797960 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a1d0c89b-1084-4ed7-bcc8-cf1314ee14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:38.803274 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1393/2733] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:38 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:38.805164 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a559c-60d0-49e4-b0e6-22e11290c9cb admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:38.807991 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-f69a559c-60d0-49e4-b0e6-22e11290c9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:38.810056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1341/2734] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:38.819143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76664bb8-e7d9-4681-9365-12497c33d282 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.819476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76664bb8-e7d9-4681-9365-12497c33d282 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.819972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76664bb8-e7d9-4681-9365-12497c33d282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.829561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a559c-60d0-49e4-b0e6-22e11290c9cb admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:38.837187 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9040d9-866e-484f-a8ec-dba80c5aac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:38.838219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9040d9-866e-484f-a8ec-dba80c5aac72 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.838678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9040d9-866e-484f-a8ec-dba80c5aac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.839718 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9040d9-866e-484f-a8ec-dba80c5aac72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.840890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9040d9-866e-484f-a8ec-dba80c5aac72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:38.841429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-76664bb8-e7d9-4681-9365-12497c33d282 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:38.842544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-76664bb8-e7d9-4681-9365-12497c33d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:38.843917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9040d9-866e-484f-a8ec-dba80c5aac72 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:38.852421 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1342/2735] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:38.857554 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76664bb8-e7d9-4681-9365-12497c33d282 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:38.861705 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1394/2736] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:38.867212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9040d9-866e-484f-a8ec-dba80c5aac72 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:38.877911 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76664bb8-e7d9-4681-9365-12497c33d282 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:38.879234 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9040d9-866e-484f-a8ec-dba80c5aac72 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:38.885032 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c64fd-2e11-416e-ab16-519983a849e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:38.885827 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c64fd-2e11-416e-ab16-519983a849e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.886191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c64fd-2e11-416e-ab16-519983a849e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.886561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c64fd-2e11-416e-ab16-519983a849e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.886714 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83065d-a995-47d6-bad1-febac834e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:38.887627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c64fd-2e11-416e-ab16-519983a849e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:38.887767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83065d-a995-47d6-bad1-febac834e062 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.888318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83065d-a995-47d6-bad1-febac834e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.888795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83065d-a995-47d6-bad1-febac834e062 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.889654 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c64fd-2e11-416e-ab16-519983a849e6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:38.890187 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83065d-a995-47d6-bad1-febac834e062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:33:38.890747 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83065d-a995-47d6-bad1-febac834e062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:38.894885 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83065d-a995-47d6-bad1-febac834e062 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:38.903710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1395/2737] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:38.907885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c64fd-2e11-416e-ab16-519983a849e6 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:38.918950 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c64fd-2e11-416e-ab16-519983a849e6 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:38.922849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1343/2738] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:33:38.925037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83065d-a995-47d6-bad1-febac834e062 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:38.929018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee05f98-be33-4d6c-898a-dee13cdd0cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:38.930190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee05f98-be33-4d6c-898a-dee13cdd0cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.930483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee05f98-be33-4d6c-898a-dee13cdd0cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.930838 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee05f98-be33-4d6c-898a-dee13cdd0cbc admin admin] PATH_INFO: `/v3/projects/4d5d8883ea3541c18d64db4aacb90a15/users/8a15d74cbac547979dcdeb292aa37875/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.940663 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83065d-a995-47d6-bad1-febac834e062 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:38.947095 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c608c-9231-4ee3-b3d2-3cbbd4a907ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:38.948071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c608c-9231-4ee3-b3d2-3cbbd4a907ab admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.948357 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c608c-9231-4ee3-b3d2-3cbbd4a907ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.948634 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c608c-9231-4ee3-b3d2-3cbbd4a907ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:38.949835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c608c-9231-4ee3-b3d2-3cbbd4a907ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:38.952972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c608c-9231-4ee3-b3d2-3cbbd4a907ab admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:38.960666 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee05f98-be33-4d6c-898a-dee13cdd0cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5d8883ea3541c18d64db4aacb90a15, user_id=8a15d74cbac547979dcdeb292aa37875, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:38.964515 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee05f98-be33-4d6c-898a-dee13cdd0cbc admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:38.986660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1396/2739] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:38 2022] PUT /identity/v3/projects/4d5d8883ea3541c18d64db4aacb90a15/users/8a15d74cbac547979dcdeb292aa37875/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:38.997632 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac81f2-40ea-4a42-9405-df79007893f7 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:38.997970 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac81f2-40ea-4a42-9405-df79007893f7 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:38.998325 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac81f2-40ea-4a42-9405-df79007893f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.020159 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1344/2740] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:38 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:39.027527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c608c-9231-4ee3-b3d2-3cbbd4a907ab admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.034726 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-e8ac81f2-40ea-4a42-9405-df79007893f7 None None] MFA Rules not processed for user `8a15d74cbac547979dcdeb292aa37875`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:39.036240 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e8ac81f2-40ea-4a42-9405-df79007893f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:39.114649 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:39.164537 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:39.189451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1397/2741] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:39.194866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c608c-9231-4ee3-b3d2-3cbbd4a907ab admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.196264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac81f2-40ea-4a42-9405-df79007893f7 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.210769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27895c-4cf5-44e9-b58f-e0cbe99ccc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:39.212788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27895c-4cf5-44e9-b58f-e0cbe99ccc96 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.213639 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27895c-4cf5-44e9-b58f-e0cbe99ccc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.214616 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27895c-4cf5-44e9-b58f-e0cbe99ccc96 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.215794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac81f2-40ea-4a42-9405-df79007893f7 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.216813 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27895c-4cf5-44e9-b58f-e0cbe99ccc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:39.222088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27895c-4cf5-44e9-b58f-e0cbe99ccc96 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:39.226620 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48102-e37d-49bd-8ec4-8bf148bb05fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:39.229293 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48102-e37d-49bd-8ec4-8bf148bb05fe admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.229811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48102-e37d-49bd-8ec4-8bf148bb05fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.230324 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48102-e37d-49bd-8ec4-8bf148bb05fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.232686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d48102-e37d-49bd-8ec4-8bf148bb05fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:39.238939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d48102-e37d-49bd-8ec4-8bf148bb05fe admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:39.272632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1345/2742] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:39 2022] POST /identity/v3/users => generated 296 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:39.280973 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27895c-4cf5-44e9-b58f-e0cbe99ccc96 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.306710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1398/2743] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:39 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:39.308184 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27895c-4cf5-44e9-b58f-e0cbe99ccc96 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.308754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48102-e37d-49bd-8ec4-8bf148bb05fe admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.435507 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65405-7d13-4420-a095-55d9c47d9778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:39.436386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65405-7d13-4420-a095-55d9c47d9778 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.436783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65405-7d13-4420-a095-55d9c47d9778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.437291 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65405-7d13-4420-a095-55d9c47d9778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.438025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb65405-7d13-4420-a095-55d9c47d9778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:39.439897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb65405-7d13-4420-a095-55d9c47d9778 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:39.450096 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48102-e37d-49bd-8ec4-8bf148bb05fe admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.453402 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1346/2744] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:33:39.459178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65405-7d13-4420-a095-55d9c47d9778 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.461017 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75df1d-358d-4a68-8ddf-746cc4f9803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:39.462531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75df1d-358d-4a68-8ddf-746cc4f9803e admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.463126 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75df1d-358d-4a68-8ddf-746cc4f9803e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.464115 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75df1d-358d-4a68-8ddf-746cc4f9803e admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.465915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75df1d-358d-4a68-8ddf-746cc4f9803e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:39.470562 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75df1d-358d-4a68-8ddf-746cc4f9803e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:39.479799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65405-7d13-4420-a095-55d9c47d9778 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.495692 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba1c0-1606-4d57-ab68-edbfbb7868d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:39.498040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba1c0-1606-4d57-ab68-edbfbb7868d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.498625 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba1c0-1606-4d57-ab68-edbfbb7868d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.499695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba1c0-1606-4d57-ab68-edbfbb7868d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.501281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba1c0-1606-4d57-ab68-edbfbb7868d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:39.506021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba1c0-1606-4d57-ab68-edbfbb7868d4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:39.513428 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1399/2745] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:39 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:33:39.519105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75df1d-358d-4a68-8ddf-746cc4f9803e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.536128 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1347/2746] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:39.538440 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba1c0-1606-4d57-ab68-edbfbb7868d4 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.540388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75df1d-358d-4a68-8ddf-746cc4f9803e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.549353 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fc48c-86a1-4206-a78e-36337b5fcc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:39.551909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fc48c-86a1-4206-a78e-36337b5fcc11 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.552412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fc48c-86a1-4206-a78e-36337b5fcc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.552907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fc48c-86a1-4206-a78e-36337b5fcc11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.554314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fc48c-86a1-4206-a78e-36337b5fcc11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:39.557174 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba1c0-1606-4d57-ab68-edbfbb7868d4 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.557750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fc48c-86a1-4206-a78e-36337b5fcc11 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:39.563644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6508d8c-7554-4de4-a133-ba67e0380b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:39.564618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508d8c-7554-4de4-a133-ba67e0380b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.564864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508d8c-7554-4de4-a133-ba67e0380b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.565144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508d8c-7554-4de4-a133-ba67e0380b98 admin admin] PATH_INFO: `/v3/projects/17223305741e41b4aa7bde8b2a1d7200/users/38c3832df4c24b5cae4681a3f9a42333/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.586097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1400/2747] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:33:39.587785 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fc48c-86a1-4206-a78e-36337b5fcc11 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.607104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6508d8c-7554-4de4-a133-ba67e0380b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17223305741e41b4aa7bde8b2a1d7200, user_id=38c3832df4c24b5cae4681a3f9a42333, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:39.609278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fc48c-86a1-4206-a78e-36337b5fcc11 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.613524 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6508d8c-7554-4de4-a133-ba67e0380b98 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:39.623665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed85def-6a26-4173-a461-78f88c064e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:39.625868 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85def-6a26-4173-a461-78f88c064e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.628331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85def-6a26-4173-a461-78f88c064e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.630657 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85def-6a26-4173-a461-78f88c064e07 admin admin] PATH_INFO: `/v3/projects/bfd618944eff4f2c9a57347029da91cb/users/82dba3da91d248fab1c605d3a994194b/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.670878 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1348/2748] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:39 2022] PUT /identity/v3/projects/17223305741e41b4aa7bde8b2a1d7200/users/38c3832df4c24b5cae4681a3f9a42333/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:39.674683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e348dd9-4ebf-4955-842b-d142dcc1b60d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.674987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e348dd9-4ebf-4955-842b-d142dcc1b60d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.675235 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e348dd9-4ebf-4955-842b-d142dcc1b60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.681594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed85def-6a26-4173-a461-78f88c064e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd618944eff4f2c9a57347029da91cb, user_id=82dba3da91d248fab1c605d3a994194b, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:39.684624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed85def-6a26-4173-a461-78f88c064e07 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:39.708818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1401/2749] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:39 2022] PUT /identity/v3/projects/bfd618944eff4f2c9a57347029da91cb/users/82dba3da91d248fab1c605d3a994194b/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:39.713166 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed85def-6a26-4173-a461-78f88c064e07 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.732257 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2e348dd9-4ebf-4955-842b-d142dcc1b60d None None] MFA Rules not processed for user `38c3832df4c24b5cae4681a3f9a42333`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:39.733542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2e348dd9-4ebf-4955-842b-d142dcc1b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:39.812104 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed85def-6a26-4173-a461-78f88c064e07 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.818891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094055a1-04a6-4ade-9761-3629af044794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:39.819614 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094055a1-04a6-4ade-9761-3629af044794 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.819909 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094055a1-04a6-4ade-9761-3629af044794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.820193 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094055a1-04a6-4ade-9761-3629af044794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.820962 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094055a1-04a6-4ade-9761-3629af044794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:39.822783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094055a1-04a6-4ade-9761-3629af044794 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:39.831871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:39.839538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1402/2750] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:39.845083 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094055a1-04a6-4ade-9761-3629af044794 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.873721 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094055a1-04a6-4ade-9761-3629af044794 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.889369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec068824-bcf9-47fa-88bf-08a2e66a55a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:39.891028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068824-bcf9-47fa-88bf-08a2e66a55a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.891486 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068824-bcf9-47fa-88bf-08a2e66a55a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.892049 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068824-bcf9-47fa-88bf-08a2e66a55a0 admin admin] PATH_INFO: `/v3/projects/bfd618944eff4f2c9a57347029da91cb/users/82dba3da91d248fab1c605d3a994194b/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.897232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec068824-bcf9-47fa-88bf-08a2e66a55a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd618944eff4f2c9a57347029da91cb, user_id=82dba3da91d248fab1c605d3a994194b, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:39.904223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec068824-bcf9-47fa-88bf-08a2e66a55a0 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:39.912292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1349/2751] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:39.919431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e348dd9-4ebf-4955-842b-d142dcc1b60d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:39.946243 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e348dd9-4ebf-4955-842b-d142dcc1b60d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:39.950743 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1403/2752] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:39 2022] PUT /identity/v3/projects/bfd618944eff4f2c9a57347029da91cb/users/82dba3da91d248fab1c605d3a994194b/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:39.959554 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea06f5-b2fc-4882-be11-2091b1856812 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:39.959879 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea06f5-b2fc-4882-be11-2091b1856812 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:39.960042 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea06f5-b2fc-4882-be11-2091b1856812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:39.993475 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-35ea06f5-b2fc-4882-be11-2091b1856812 None None] MFA Rules not processed for user `82dba3da91d248fab1c605d3a994194b`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:39.994707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-35ea06f5-b2fc-4882-be11-2091b1856812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:40.033167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:40.123546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c231d4-676a-4095-b25a-1e979782230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:40.124891 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c231d4-676a-4095-b25a-1e979782230c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:40.125449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c231d4-676a-4095-b25a-1e979782230c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:40.125981 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c231d4-676a-4095-b25a-1e979782230c admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:40.127653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c231d4-676a-4095-b25a-1e979782230c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:40.129527 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1404/2753] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:40.131988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c231d4-676a-4095-b25a-1e979782230c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:40.142258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea06f5-b2fc-4882-be11-2091b1856812 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:40.143908 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-35ea06f5-b2fc-4882-be11-2091b1856812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:40.193707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1350/2754] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:39 2022] POST /identity/v3/projects => generated 391 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:40.195839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c231d4-676a-4095-b25a-1e979782230c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:40.244294 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea06f5-b2fc-4882-be11-2091b1856812 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:40.316468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c231d4-676a-4095-b25a-1e979782230c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:40.321458 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d971b-ca4d-45ba-ad97-c7f16400e601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:40.322540 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d971b-ca4d-45ba-ad97-c7f16400e601 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:40.323026 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d971b-ca4d-45ba-ad97-c7f16400e601 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:40.324019 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d971b-ca4d-45ba-ad97-c7f16400e601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:40.324252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5da038-6455-4930-90f4-65ec27dd3e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:40.324456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5da038-6455-4930-90f4-65ec27dd3e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:40.324897 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5da038-6455-4930-90f4-65ec27dd3e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:40.325084 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5da038-6455-4930-90f4-65ec27dd3e0b admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:40.325869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5da038-6455-4930-90f4-65ec27dd3e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:40.328386 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5da038-6455-4930-90f4-65ec27dd3e0b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:40.357463 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1351/2755] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:40 2022] POST /identity/v3/users => generated 302 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:40.362817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5da038-6455-4930-90f4-65ec27dd3e0b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:40.386073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5da038-6455-4930-90f4-65ec27dd3e0b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:40.392473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fcacf-fa2c-425c-beba-28d9f3475bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:40.393270 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fcacf-fa2c-425c-beba-28d9f3475bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:40.393644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fcacf-fa2c-425c-beba-28d9f3475bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:40.394042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fcacf-fa2c-425c-beba-28d9f3475bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:40.394971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fcacf-fa2c-425c-beba-28d9f3475bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:40.397545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fcacf-fa2c-425c-beba-28d9f3475bb3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:40.398985 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:40.419505 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1352/2756] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:40.421138 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fcacf-fa2c-425c-beba-28d9f3475bb3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:40.434361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d971b-ca4d-45ba-ad97-c7f16400e601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:40.436084 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d971b-ca4d-45ba-ad97-c7f16400e601 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:40.439684 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fcacf-fa2c-425c-beba-28d9f3475bb3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:40.448791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1405/2757] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:40.451689 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f32287-1d1e-4e01-9c57-f19afa30bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:40.452600 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f32287-1d1e-4e01-9c57-f19afa30bb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:40.452986 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f32287-1d1e-4e01-9c57-f19afa30bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:40.453392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f32287-1d1e-4e01-9c57-f19afa30bb79 admin admin] PATH_INFO: `/v3/projects/268e1458193041dbbf12c29b2e3ce8b2/users/e7d4631159484487a3d4a811b2e083cb/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:40.477759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f32287-1d1e-4e01-9c57-f19afa30bb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=268e1458193041dbbf12c29b2e3ce8b2, user_id=e7d4631159484487a3d4a811b2e083cb, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:40.483185 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f32287-1d1e-4e01-9c57-f19afa30bb79 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:40.521850 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1353/2758] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:40 2022] PUT /identity/v3/projects/268e1458193041dbbf12c29b2e3ce8b2/users/e7d4631159484487a3d4a811b2e083cb/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:40.526730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d971b-ca4d-45ba-ad97-c7f16400e601 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:40.545296 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d971b-ca4d-45ba-ad97-c7f16400e601 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:40.668708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f56be-3cfc-445e-9fc0-f481a2307afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:40.669624 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f56be-3cfc-445e-9fc0-f481a2307afd admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:40.669912 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f56be-3cfc-445e-9fc0-f481a2307afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:40.670204 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f56be-3cfc-445e-9fc0-f481a2307afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:40.671007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f56be-3cfc-445e-9fc0-f481a2307afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:40.672730 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f56be-3cfc-445e-9fc0-f481a2307afd admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:40.689896 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1406/2759] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:40.691705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f32287-1d1e-4e01-9c57-f19afa30bb79 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:40.713608 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f32287-1d1e-4e01-9c57-f19afa30bb79 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:40.723945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef132a67-eb2e-4bf3-a56a-8112a3d3ea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:40.725603 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef132a67-eb2e-4bf3-a56a-8112a3d3ea20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:40.726181 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef132a67-eb2e-4bf3-a56a-8112a3d3ea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:40.726788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef132a67-eb2e-4bf3-a56a-8112a3d3ea20 admin admin] PATH_INFO: `/v3/projects/268e1458193041dbbf12c29b2e3ce8b2/users/e7d4631159484487a3d4a811b2e083cb/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:40.732003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef132a67-eb2e-4bf3-a56a-8112a3d3ea20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=268e1458193041dbbf12c29b2e3ce8b2, user_id=e7d4631159484487a3d4a811b2e083cb, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:40.737086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef132a67-eb2e-4bf3-a56a-8112a3d3ea20 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:40.752413 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1354/2760] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:40 2022] PUT /identity/v3/projects/268e1458193041dbbf12c29b2e3ce8b2/users/e7d4631159484487a3d4a811b2e083cb/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:40.770707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924069-21a4-4eac-9ab5-99a996de089a None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:40.770707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924069-21a4-4eac-9ab5-99a996de089a None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:40.770707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924069-21a4-4eac-9ab5-99a996de089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:40.826573 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9e924069-21a4-4eac-9ab5-99a996de089a None None] MFA Rules not processed for user `e7d4631159484487a3d4a811b2e083cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:40.828267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9e924069-21a4-4eac-9ab5-99a996de089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:40.939472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1407/2761] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:40.959188 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef132a67-eb2e-4bf3-a56a-8112a3d3ea20 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:40.962769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ef132a67-eb2e-4bf3-a56a-8112a3d3ea20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:41.092451 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef132a67-eb2e-4bf3-a56a-8112a3d3ea20 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:41.102851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c2047-8703-49bd-b462-6f0ad30cc211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:41.104695 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c2047-8703-49bd-b462-6f0ad30cc211 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:41.104912 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c2047-8703-49bd-b462-6f0ad30cc211 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:41.105387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c2047-8703-49bd-b462-6f0ad30cc211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:41.132757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c2047-8703-49bd-b462-6f0ad30cc211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:41.136329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c2047-8703-49bd-b462-6f0ad30cc211 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:41.147976 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:41.160630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1355/2762] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:41.246972 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924069-21a4-4eac-9ab5-99a996de089a None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:41.285107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924069-21a4-4eac-9ab5-99a996de089a None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:41.292809 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aec6d0-c77a-4826-8c5a-031d1e5ebc45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:41.294221 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec6d0-c77a-4826-8c5a-031d1e5ebc45 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:41.294946 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec6d0-c77a-4826-8c5a-031d1e5ebc45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:41.295476 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec6d0-c77a-4826-8c5a-031d1e5ebc45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:41.500362 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aec6d0-c77a-4826-8c5a-031d1e5ebc45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:41.503267 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aec6d0-c77a-4826-8c5a-031d1e5ebc45 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:41.510574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:41.526266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1408/2763] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:42.219787 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c2047-8703-49bd-b462-6f0ad30cc211 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:42.223920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9c7c2047-8703-49bd-b462-6f0ad30cc211 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:42.356073 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c2047-8703-49bd-b462-6f0ad30cc211 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:42.363504 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:42.364830 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:42.365279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:42.365728 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] PATH_INFO: `/v3/users/a394fc62e6a64a85b855bf2eb56b4b71` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:42.367770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a394fc62e6a64a85b855bf2eb56b4b71)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:42.371227 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:42.450704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a394fc62e6a64a85b855bf2eb56b4b71'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:42.463988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a394fc62e6a64a85b855bf2eb56b4b71'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:42.466350 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a394fc62e6a64a85b855bf2eb56b4b71'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:42.504056 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a394fc62e6a64a85b855bf2eb56b4b71'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:42.517541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a394fc62e6a64a85b855bf2eb56b4b71'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:42.527195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1356/2764] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:42 2022] DELETE /identity/v3/users/a394fc62e6a64a85b855bf2eb56b4b71 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:42.832931 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aec6d0-c77a-4826-8c5a-031d1e5ebc45 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:42.864525 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aec6d0-c77a-4826-8c5a-031d1e5ebc45 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:42.970370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:42.971333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:42.971613 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:42.971891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] PATH_INFO: `/v3/projects/a4a87feacfb84d6c9f7ea48f230753b7` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:42.973323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a87feacfb84d6c9f7ea48f230753b7)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:42.975662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:43.039415 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:43.041729 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:43.046481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a87feacfb84d6c9f7ea48f230753b7', 'request_id': 'req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.069644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d2519-b5c3-40e8-8bf4-9ba629523063 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:43.150727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a87feacfb84d6c9f7ea48f230753b7', 'request_id': 'req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.165266 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a87feacfb84d6c9f7ea48f230753b7', 'request_id': 'req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.193750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] The token cache is being invalidate because project a4a87feacfb84d6c9f7ea48f230753b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:43.193750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.193750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.193750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1409/2765] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:42 2022] DELETE /identity/v3/projects/a4a87feacfb84d6c9f7ea48f230753b7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:43.193750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:43.194832 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:43.196045 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:43.200717 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:43.202839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:43.203499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] PATH_INFO: `/v3/users/8a15d74cbac547979dcdeb292aa37875` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:43.208044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a15d74cbac547979dcdeb292aa37875)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:43.210281 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:43.220557 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a7aa3-0f85-4749-97fa-2f41302fc39a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:43.234640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:43.236302 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:43.236944 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:43.239715 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] PATH_INFO: `/v3/users/f2bd9c8578b84a73a47074deafb3e373` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:43.247903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:43.276089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2bd9c8578b84a73a47074deafb3e373)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:43.278828 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:43.308004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a15d74cbac547979dcdeb292aa37875'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.324855 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a15d74cbac547979dcdeb292aa37875'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.326389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a15d74cbac547979dcdeb292aa37875'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.342062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a15d74cbac547979dcdeb292aa37875'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.352665 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2bd9c8578b84a73a47074deafb3e373'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.353716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2bd9c8578b84a73a47074deafb3e373'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.354594 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2bd9c8578b84a73a47074deafb3e373'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.355139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869dc77b-a450-4a6b-bf9f-83d7cf6590bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a15d74cbac547979dcdeb292aa37875'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.368004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1357/2766] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:43 2022] DELETE /identity/v3/users/8a15d74cbac547979dcdeb292aa37875 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:43.370558 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2bd9c8578b84a73a47074deafb3e373'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.375457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fe14-ef99-44bf-a7b4-953f4722951e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:43.376136 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fe14-ef99-44bf-a7b4-953f4722951e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:43.376769 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fe14-ef99-44bf-a7b4-953f4722951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:43.381493 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2bd9c8578b84a73a47074deafb3e373'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:43.387884 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:43.397534 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7f24fe14-ef99-44bf-a7b4-953f4722951e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:43.398847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7f24fe14-ef99-44bf-a7b4-953f4722951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:43.418249 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1410/2767] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:43 2022] DELETE /identity/v3/users/f2bd9c8578b84a73a47074deafb3e373 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:43.532676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1358/2768] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:43.546675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:43.549031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:43.665494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7eca9-af4f-4bb4-bc3b-071cc4b5b174 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:43.672074 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed493-d5b5-4fa4-a10c-bd8caa89583c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:43.675610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed493-d5b5-4fa4-a10c-bd8caa89583c service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:43.675610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed493-d5b5-4fa4-a10c-bd8caa89583c service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:43.675610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed493-d5b5-4fa4-a10c-bd8caa89583c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:43.752260 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fe14-ef99-44bf-a7b4-953f4722951e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:43.754795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7f24fe14-ef99-44bf-a7b4-953f4722951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:43.780501 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fe14-ef99-44bf-a7b4-953f4722951e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:43.817146 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fed493-d5b5-4fa4-a10c-bd8caa89583c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:43.820218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fed493-d5b5-4fa4-a10c-bd8caa89583c service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:43.841154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1411/2769] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:43.921041 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:43.921939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:43.922218 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:43.922528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] PATH_INFO: `/v3/projects/fc7af3c9681f48128af2dbee6c4c13c2` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:43.938428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7af3c9681f48128af2dbee6c4c13c2)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:43.943036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:44.011527 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:44.039014 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7af3c9681f48128af2dbee6c4c13c2', 'request_id': 'req-4d53beff-fdc6-47f4-8a43-953aeab02fc1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.054848 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7af3c9681f48128af2dbee6c4c13c2', 'request_id': 'req-4d53beff-fdc6-47f4-8a43-953aeab02fc1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.072475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7af3c9681f48128af2dbee6c4c13c2', 'request_id': 'req-4d53beff-fdc6-47f4-8a43-953aeab02fc1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.107024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] The token cache is being invalidate because project fc7af3c9681f48128af2dbee6c4c13c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:44.107487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.108715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.111945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1359/2770] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:43 2022] DELETE /identity/v3/projects/fc7af3c9681f48128af2dbee6c4c13c2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:44.321018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed493-d5b5-4fa4-a10c-bd8caa89583c service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:44.323367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-88fed493-d5b5-4fa4-a10c-bd8caa89583c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:44.347851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed493-d5b5-4fa4-a10c-bd8caa89583c service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:44.465467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:44.467318 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:44.467913 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:44.468480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] PATH_INFO: `/v3/projects/4d5d8883ea3541c18d64db4aacb90a15` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:44.471328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5d8883ea3541c18d64db4aacb90a15)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:44.474720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:44.565999 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:44.581689 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5d8883ea3541c18d64db4aacb90a15', 'request_id': 'req-815917fd-74f4-45ed-9f5f-0eab0419ac02'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.597963 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5d8883ea3541c18d64db4aacb90a15', 'request_id': 'req-815917fd-74f4-45ed-9f5f-0eab0419ac02'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.607287 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5d8883ea3541c18d64db4aacb90a15', 'request_id': 'req-815917fd-74f4-45ed-9f5f-0eab0419ac02'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.635381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] The token cache is being invalidate because project 4d5d8883ea3541c18d64db4aacb90a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:44.635734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.637359 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.643633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1412/2771] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:44 2022] DELETE /identity/v3/projects/4d5d8883ea3541c18d64db4aacb90a15 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:44.648494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:44.650837 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:44.676555 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53beff-fdc6-47f4-8a43-953aeab02fc1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:44.775617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:44.776720 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:44.777066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:44.777462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] PATH_INFO: `/v3/users/82dba3da91d248fab1c605d3a994194b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:44.779596 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82dba3da91d248fab1c605d3a994194b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:44.781751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:44.791374 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:44.793245 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:44.853042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82dba3da91d248fab1c605d3a994194b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.870125 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82dba3da91d248fab1c605d3a994194b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.871027 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82dba3da91d248fab1c605d3a994194b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.889888 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82dba3da91d248fab1c605d3a994194b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.899964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82dba3da91d248fab1c605d3a994194b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:44.912231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1360/2772] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:44 2022] DELETE /identity/v3/users/82dba3da91d248fab1c605d3a994194b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:44.931892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815917fd-74f4-45ed-9f5f-0eab0419ac02 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:45.005056 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea136c-8648-4ed9-bb19-1b7e24d6e499 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:45.005753 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea136c-8648-4ed9-bb19-1b7e24d6e499 service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:45.006031 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea136c-8648-4ed9-bb19-1b7e24d6e499 service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:45.006492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea136c-8648-4ed9-bb19-1b7e24d6e499 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:45.009035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-43ea136c-8648-4ed9-bb19-1b7e24d6e499 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:45.022885 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea136c-8648-4ed9-bb19-1b7e24d6e499 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:45.024945 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea136c-8648-4ed9-bb19-1b7e24d6e499 service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:45.037684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1413/2773] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:45.298945 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:45.301372 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:45.357782 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:45.387305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcb420-b024-42d0-95a3-911558b5a821 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:45.392663 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:45.393618 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:45.393928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:45.394209 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] PATH_INFO: `/v3/projects/bfd618944eff4f2c9a57347029da91cb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:45.396280 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd618944eff4f2c9a57347029da91cb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:45.397783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:45.456458 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd618944eff4f2c9a57347029da91cb', 'request_id': 'req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:45.465210 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd618944eff4f2c9a57347029da91cb', 'request_id': 'req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:45.477826 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd618944eff4f2c9a57347029da91cb', 'request_id': 'req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:45.494086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] The token cache is being invalidate because project bfd618944eff4f2c9a57347029da91cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:45.494852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:45.495587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d2b29a2e-6b8c-4de9-a0fc-870d46cc0218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:45.500799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1361/2774] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:45 2022] DELETE /identity/v3/projects/bfd618944eff4f2c9a57347029da91cb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:45.502663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09288d45-3b58-4bb5-bc23-ce4bd73495b3 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:45.502959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09288d45-3b58-4bb5-bc23-ce4bd73495b3 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:45.503244 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09288d45-3b58-4bb5-bc23-ce4bd73495b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:45.522411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-09288d45-3b58-4bb5-bc23-ce4bd73495b3 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:45.523731 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-09288d45-3b58-4bb5-bc23-ce4bd73495b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:45.570242 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:45.610840 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1414/2775] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:45.612732 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf65f2-9206-45fa-a2da-41086c752c78 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:45.613044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf65f2-9206-45fa-a2da-41086c752c78 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:45.613311 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf65f2-9206-45fa-a2da-41086c752c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:45.633906 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9edf65f2-9206-45fa-a2da-41086c752c78 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:45.635279 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9edf65f2-9206-45fa-a2da-41086c752c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:45.650990 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1362/2776] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:45.656710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09288d45-3b58-4bb5-bc23-ce4bd73495b3 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:45.667555 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09288d45-3b58-4bb5-bc23-ce4bd73495b3 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:45.672631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b53e3a-f493-4255-9433-ba9354bb7c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:45.673328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53e3a-f493-4255-9433-ba9354bb7c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:45.673615 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53e3a-f493-4255-9433-ba9354bb7c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:45.673897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53e3a-f493-4255-9433-ba9354bb7c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:45.674677 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53e3a-f493-4255-9433-ba9354bb7c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:33:45.674992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53e3a-f493-4255-9433-ba9354bb7c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:45.676662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53e3a-f493-4255-9433-ba9354bb7c9a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:45.689912 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1415/2777] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:33:45.695000 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf65f2-9206-45fa-a2da-41086c752c78 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:45.705494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf65f2-9206-45fa-a2da-41086c752c78 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:45.710774 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e9405-57a4-4d51-943e-045edaf59430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:45.711455 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9405-57a4-4d51-943e-045edaf59430 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:45.711739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9405-57a4-4d51-943e-045edaf59430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:45.712012 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9405-57a4-4d51-943e-045edaf59430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:45.712779 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e9405-57a4-4d51-943e-045edaf59430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:45.714791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e9405-57a4-4d51-943e-045edaf59430 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:45.749182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1363/2778] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:45 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:45.750829 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b53e3a-f493-4255-9433-ba9354bb7c9a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:45.763231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b53e3a-f493-4255-9433-ba9354bb7c9a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:45.829678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa619b8-5a52-43bd-9025-9826abaf6a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:45.830381 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa619b8-5a52-43bd-9025-9826abaf6a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:45.830716 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa619b8-5a52-43bd-9025-9826abaf6a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:45.831010 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa619b8-5a52-43bd-9025-9826abaf6a55 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:45.831719 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa619b8-5a52-43bd-9025-9826abaf6a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:45.833850 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa619b8-5a52-43bd-9025-9826abaf6a55 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:45.856720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1416/2779] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:45 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:45.861395 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e9405-57a4-4d51-943e-045edaf59430 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:45.873605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e9405-57a4-4d51-943e-045edaf59430 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:45.880391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed3741-7f57-4f11-bcb6-ab2ea38b149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:45.881145 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3741-7f57-4f11-bcb6-ab2ea38b149b admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:45.881381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3741-7f57-4f11-bcb6-ab2ea38b149b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:45.881872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3741-7f57-4f11-bcb6-ab2ea38b149b admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:45.882687 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed3741-7f57-4f11-bcb6-ab2ea38b149b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:45.884379 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed3741-7f57-4f11-bcb6-ab2ea38b149b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:45.904158 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1364/2780] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:45.909047 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa619b8-5a52-43bd-9025-9826abaf6a55 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:45.920701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa619b8-5a52-43bd-9025-9826abaf6a55 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:45.927759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e1b4e-015f-4ac7-9dc2-a219f9e8b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:45.928713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e1b4e-015f-4ac7-9dc2-a219f9e8b81e admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:45.929173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e1b4e-015f-4ac7-9dc2-a219f9e8b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:45.929538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e1b4e-015f-4ac7-9dc2-a219f9e8b81e admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:45.930800 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e1b4e-015f-4ac7-9dc2-a219f9e8b81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:45.933086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e1b4e-015f-4ac7-9dc2-a219f9e8b81e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:45.946565 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1417/2781] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:45.952401 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed3741-7f57-4f11-bcb6-ab2ea38b149b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:45.966901 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e1b4e-015f-4ac7-9dc2-a219f9e8b81e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:45.969698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a03e1b4e-015f-4ac7-9dc2-a219f9e8b81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:45.971605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed3741-7f57-4f11-bcb6-ab2ea38b149b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:45.982414 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b9126-067b-4cfc-a965-d2a801c6fbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:45.984263 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9126-067b-4cfc-a965-d2a801c6fbd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:45.984821 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9126-067b-4cfc-a965-d2a801c6fbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:45.985428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9126-067b-4cfc-a965-d2a801c6fbd7 admin admin] PATH_INFO: `/v3/projects/47fea2bbb4f9439d93786a9c57c2ff22/users/cc0992805e1d4c2a928ca036a17cb86b/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:45.995738 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e1b4e-015f-4ac7-9dc2-a219f9e8b81e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:46.005198 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:46.006847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.007343 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.008189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] PATH_INFO: `/v3/users/38c3832df4c24b5cae4681a3f9a42333` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.010756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c3832df4c24b5cae4681a3f9a42333)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:46.015191 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:46.016676 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b9126-067b-4cfc-a965-d2a801c6fbd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47fea2bbb4f9439d93786a9c57c2ff22, user_id=cc0992805e1d4c2a928ca036a17cb86b, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:46.022261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b9126-067b-4cfc-a965-d2a801c6fbd7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:46.047655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1365/2782] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:45 2022] PUT /identity/v3/projects/47fea2bbb4f9439d93786a9c57c2ff22/users/cc0992805e1d4c2a928ca036a17cb86b/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:46.068097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a348c-6a5a-4b69-bd17-f0041a9fbcaa None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.068566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a348c-6a5a-4b69-bd17-f0041a9fbcaa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.069033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a348c-6a5a-4b69-bd17-f0041a9fbcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.110531 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c3832df4c24b5cae4681a3f9a42333'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:46.111878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c3832df4c24b5cae4681a3f9a42333'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:46.114134 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c3832df4c24b5cae4681a3f9a42333'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:46.129380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ee0a348c-6a5a-4b69-bd17-f0041a9fbcaa None None] MFA Rules not processed for user `cc0992805e1d4c2a928ca036a17cb86b`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:46.131681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ee0a348c-6a5a-4b69-bd17-f0041a9fbcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:46.140622 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c3832df4c24b5cae4681a3f9a42333'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:46.154436 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-619e8132-969b-46d3-96ed-b8a0d735da56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c3832df4c24b5cae4681a3f9a42333'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:46.178440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1418/2783] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:45 2022] DELETE /identity/v3/users/38c3832df4c24b5cae4681a3f9a42333 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:46.184170 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be57d2-ae84-4332-8a6b-c7a725f6550b None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.186117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be57d2-ae84-4332-8a6b-c7a725f6550b None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.186117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be57d2-ae84-4332-8a6b-c7a725f6550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.216160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-97be57d2-ae84-4332-8a6b-c7a725f6550b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:46.218292 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-97be57d2-ae84-4332-8a6b-c7a725f6550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:46.227261 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:46.239256 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:46.255686 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1366/2784] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:46.257970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a348c-6a5a-4b69-bd17-f0041a9fbcaa None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:46.260522 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ee0a348c-6a5a-4b69-bd17-f0041a9fbcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:46.297259 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1419/2785] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:46.309869 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be57d2-ae84-4332-8a6b-c7a725f6550b None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:46.312213 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-97be57d2-ae84-4332-8a6b-c7a725f6550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:46.363177 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a348c-6a5a-4b69-bd17-f0041a9fbcaa None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:46.368488 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53cffa-a56c-4997-8103-c3cd8fc7382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:46.369191 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53cffa-a56c-4997-8103-c3cd8fc7382a admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.369472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53cffa-a56c-4997-8103-c3cd8fc7382a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.369750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53cffa-a56c-4997-8103-c3cd8fc7382a admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.370471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53cffa-a56c-4997-8103-c3cd8fc7382a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:46.372708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53cffa-a56c-4997-8103-c3cd8fc7382a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:46.416398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1367/2786] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:46 2022] POST /identity/v3/projects => generated 401 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:46.418644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53cffa-a56c-4997-8103-c3cd8fc7382a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:46.425513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be57d2-ae84-4332-8a6b-c7a725f6550b None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:46.503453 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e851eb-767d-49a8-be93-12a683dbd768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:46.504469 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e851eb-767d-49a8-be93-12a683dbd768 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.504759 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e851eb-767d-49a8-be93-12a683dbd768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.505065 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e851eb-767d-49a8-be93-12a683dbd768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.512004 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53cffa-a56c-4997-8103-c3cd8fc7382a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:46.519021 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e851eb-767d-49a8-be93-12a683dbd768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:46.521051 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7622b-1341-442c-9522-80295bd52ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:46.521649 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e851eb-767d-49a8-be93-12a683dbd768 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:46.522448 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7622b-1341-442c-9522-80295bd52ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.523066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7622b-1341-442c-9522-80295bd52ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.523835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7622b-1341-442c-9522-80295bd52ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.525428 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7622b-1341-442c-9522-80295bd52ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:46.529425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7622b-1341-442c-9522-80295bd52ce4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:46.539645 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1420/2787] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:46.558172 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1368/2788] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:46 2022] POST /identity/v3/users => generated 307 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:46.564255 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e851eb-767d-49a8-be93-12a683dbd768 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:46.576880 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e851eb-767d-49a8-be93-12a683dbd768 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:46.582792 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec566-d331-46ba-80b7-826eb787a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:46.583572 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec566-d331-46ba-80b7-826eb787a510 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.583899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec566-d331-46ba-80b7-826eb787a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.584217 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec566-d331-46ba-80b7-826eb787a510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.585129 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ec566-d331-46ba-80b7-826eb787a510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:46.588320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ec566-d331-46ba-80b7-826eb787a510 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:46.606747 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1421/2789] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:46.612898 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7622b-1341-442c-9522-80295bd52ce4 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:46.629384 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7622b-1341-442c-9522-80295bd52ce4 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:46.636644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d28292-e793-44a0-8130-f2681f7c5862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:46.637852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28292-e793-44a0-8130-f2681f7c5862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.638308 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28292-e793-44a0-8130-f2681f7c5862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.638738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28292-e793-44a0-8130-f2681f7c5862 admin admin] PATH_INFO: `/v3/projects/a47d4c657bf8478491888909181369e9/users/7415472ad7f048d984513912529a8f03/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.661644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d28292-e793-44a0-8130-f2681f7c5862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47d4c657bf8478491888909181369e9, user_id=7415472ad7f048d984513912529a8f03, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:46.664737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d28292-e793-44a0-8130-f2681f7c5862 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:46.683099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1369/2790] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:46 2022] PUT /identity/v3/projects/a47d4c657bf8478491888909181369e9/users/7415472ad7f048d984513912529a8f03/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:46.687360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec566-d331-46ba-80b7-826eb787a510 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:46.699248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec566-d331-46ba-80b7-826eb787a510 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:46.789637 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3fafa-f90d-4afb-a07a-108b6c1f4e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:46.790487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3fafa-f90d-4afb-a07a-108b6c1f4e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.790887 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3fafa-f90d-4afb-a07a-108b6c1f4e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.791222 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3fafa-f90d-4afb-a07a-108b6c1f4e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.792037 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3fafa-f90d-4afb-a07a-108b6c1f4e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:46.794327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3fafa-f90d-4afb-a07a-108b6c1f4e55 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:46.808411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1422/2791] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:33:46.814214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d28292-e793-44a0-8130-f2681f7c5862 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:46.837037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d28292-e793-44a0-8130-f2681f7c5862 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:46.848652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d702ab-579a-441d-8de2-ffcb59aa9ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:46.849932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d702ab-579a-441d-8de2-ffcb59aa9ada admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.850397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d702ab-579a-441d-8de2-ffcb59aa9ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.850938 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d702ab-579a-441d-8de2-ffcb59aa9ada admin admin] PATH_INFO: `/v3/projects/a47d4c657bf8478491888909181369e9/users/7415472ad7f048d984513912529a8f03/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.854745 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d702ab-579a-441d-8de2-ffcb59aa9ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47d4c657bf8478491888909181369e9, user_id=7415472ad7f048d984513912529a8f03, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:46.859969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d702ab-579a-441d-8de2-ffcb59aa9ada admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:46.879759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1370/2792] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:46 2022] PUT /identity/v3/projects/a47d4c657bf8478491888909181369e9/users/7415472ad7f048d984513912529a8f03/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:46.891210 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785be03-5e35-49b4-bf4c-c8a8c48b5b47 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:46.891742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785be03-5e35-49b4-bf4c-c8a8c48b5b47 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:46.892392 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785be03-5e35-49b4-bf4c-c8a8c48b5b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:46.904841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:46.927657 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d702ab-579a-441d-8de2-ffcb59aa9ada admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:46.930528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c2d702ab-579a-441d-8de2-ffcb59aa9ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:46.945417 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-6785be03-5e35-49b4-bf4c-c8a8c48b5b47 None None] MFA Rules not processed for user `7415472ad7f048d984513912529a8f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:46.947633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-6785be03-5e35-49b4-bf4c-c8a8c48b5b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:46.997719 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:47.059182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d702ab-579a-441d-8de2-ffcb59aa9ada admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:47.067024 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:47.068353 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:47.069022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:47.069475 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] PATH_INFO: `/v3/projects/17223305741e41b4aa7bde8b2a1d7200` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:47.070431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1423/2793] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:47.071130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17223305741e41b4aa7bde8b2a1d7200)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:47.073374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:47.083331 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785be03-5e35-49b4-bf4c-c8a8c48b5b47 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:47.085162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-6785be03-5e35-49b4-bf4c-c8a8c48b5b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:47.156025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17223305741e41b4aa7bde8b2a1d7200', 'request_id': 'req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:47.167406 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17223305741e41b4aa7bde8b2a1d7200', 'request_id': 'req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:47.179519 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17223305741e41b4aa7bde8b2a1d7200', 'request_id': 'req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:47.181778 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785be03-5e35-49b4-bf4c-c8a8c48b5b47 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:47.194532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] The token cache is being invalidate because project 17223305741e41b4aa7bde8b2a1d7200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:47.194928 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:47.195620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:47.197477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1371/2794] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:46 2022] DELETE /identity/v3/projects/17223305741e41b4aa7bde8b2a1d7200 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:47.201642 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:47.203235 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:47.261480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b970f-edbf-4ff1-88d2-a6df8e734b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:47.262836 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b970f-edbf-4ff1-88d2-a6df8e734b3b service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:47.263454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b970f-edbf-4ff1-88d2-a6df8e734b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:47.263978 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b970f-edbf-4ff1-88d2-a6df8e734b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:47.267086 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-567b970f-edbf-4ff1-88d2-a6df8e734b3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:47.293886 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45cb7-8e2a-428d-a6bd-b55eeca54976 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:47.300020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:47.301150 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:47.301563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:47.301909 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] PATH_INFO: `/v3/users/e7d4631159484487a3d4a811b2e083cb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:47.303478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d4631159484487a3d4a811b2e083cb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:47.305654 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:47.366172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:47.370817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b970f-edbf-4ff1-88d2-a6df8e734b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:47.373596 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b970f-edbf-4ff1-88d2-a6df8e734b3b service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:47.385964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d4631159484487a3d4a811b2e083cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:47.395693 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1424/2795] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:47.398737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d4631159484487a3d4a811b2e083cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:47.400359 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d4631159484487a3d4a811b2e083cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:47.420032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:47.432681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d4631159484487a3d4a811b2e083cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:47.455667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d4631159484487a3d4a811b2e083cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:47.486443 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1372/2796] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:47 2022] DELETE /identity/v3/users/e7d4631159484487a3d4a811b2e083cb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:47.566186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b970f-edbf-4ff1-88d2-a6df8e734b3b service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:47.569745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-567b970f-edbf-4ff1-88d2-a6df8e734b3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:47.591095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b970f-edbf-4ff1-88d2-a6df8e734b3b service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:47.684702 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e9541-2252-4e03-803f-f06b46e996cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:47.686402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9541-2252-4e03-803f-f06b46e996cc service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:47.686402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9541-2252-4e03-803f-f06b46e996cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:47.686785 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9541-2252-4e03-803f-f06b46e996cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:47.689758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a73e9541-2252-4e03-803f-f06b46e996cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:47.823110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e9541-2252-4e03-803f-f06b46e996cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:47.824938 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e9541-2252-4e03-803f-f06b46e996cc service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:47.838034 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1425/2797] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:48.219075 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.220903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:48.358856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37a89-6e9b-4dc6-9eaa-5fe9c8a33513 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.358856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.358856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.358856 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.359495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] PATH_INFO: `/v3/projects/268e1458193041dbbf12c29b2e3ce8b2` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.359495 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=268e1458193041dbbf12c29b2e3ce8b2)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.361321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.427273 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '268e1458193041dbbf12c29b2e3ce8b2', 'request_id': 'req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:48.435498 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '268e1458193041dbbf12c29b2e3ce8b2', 'request_id': 'req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:48.445556 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '268e1458193041dbbf12c29b2e3ce8b2', 'request_id': 'req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:48.461022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] The token cache is being invalidate because project 268e1458193041dbbf12c29b2e3ce8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:48.461290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:48.462011 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7a7e91bd-4f54-48ce-a2ba-ffb8100d4d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:48.463864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1373/2798] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:48 2022] DELETE /identity/v3/projects/268e1458193041dbbf12c29b2e3ce8b2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:48.469815 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10fea-f1e1-4620-8390-4aab1095c9be None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.470487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10fea-f1e1-4620-8390-4aab1095c9be None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.470487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10fea-f1e1-4620-8390-4aab1095c9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.493713 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-71d10fea-f1e1-4620-8390-4aab1095c9be None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:48.495119 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-71d10fea-f1e1-4620-8390-4aab1095c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:48.564332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1426/2799] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:48.572957 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d207b-9b34-4da7-aca4-a89e928e4d78 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.573274 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d207b-9b34-4da7-aca4-a89e928e4d78 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.573500 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d207b-9b34-4da7-aca4-a89e928e4d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.593578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-636d207b-9b34-4da7-aca4-a89e928e4d78 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:48.594876 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-636d207b-9b34-4da7-aca4-a89e928e4d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:48.603917 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1374/2800] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:48.608465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d10fea-f1e1-4620-8390-4aab1095c9be None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.620384 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d10fea-f1e1-4620-8390-4aab1095c9be None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.628686 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23de12b-7827-45b2-97e8-7ea54e8c31cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.629394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de12b-7827-45b2-97e8-7ea54e8c31cf admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.629709 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de12b-7827-45b2-97e8-7ea54e8c31cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.629984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de12b-7827-45b2-97e8-7ea54e8c31cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.630774 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23de12b-7827-45b2-97e8-7ea54e8c31cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:33:48.631153 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23de12b-7827-45b2-97e8-7ea54e8c31cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.632873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23de12b-7827-45b2-97e8-7ea54e8c31cf admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.647561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1427/2801] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:33:48.652104 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d207b-9b34-4da7-aca4-a89e928e4d78 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.663356 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d207b-9b34-4da7-aca4-a89e928e4d78 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.669269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab378b1-6eec-44b6-91ae-2f7893dd3e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.670139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab378b1-6eec-44b6-91ae-2f7893dd3e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.670476 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab378b1-6eec-44b6-91ae-2f7893dd3e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.671176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab378b1-6eec-44b6-91ae-2f7893dd3e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.671971 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab378b1-6eec-44b6-91ae-2f7893dd3e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.673955 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab378b1-6eec-44b6-91ae-2f7893dd3e49 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.708480 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1375/2802] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:48 2022] POST /identity/v3/projects => generated 361 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:48.710630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23de12b-7827-45b2-97e8-7ea54e8c31cf admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.723367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23de12b-7827-45b2-97e8-7ea54e8c31cf admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.779784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=100 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:48.813824 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b81ecc-28be-48b1-b4bf-d23dc9fb226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.814536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b81ecc-28be-48b1-b4bf-d23dc9fb226c admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.814843 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b81ecc-28be-48b1-b4bf-d23dc9fb226c admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.815117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b81ecc-28be-48b1-b4bf-d23dc9fb226c admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.815847 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b81ecc-28be-48b1-b4bf-d23dc9fb226c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.817878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b81ecc-28be-48b1-b4bf-d23dc9fb226c admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.842445 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1428/2803] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:48 2022] POST /identity/v3/users => generated 281 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:48.847321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab378b1-6eec-44b6-91ae-2f7893dd3e49 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.859016 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab378b1-6eec-44b6-91ae-2f7893dd3e49 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.864364 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58781d86-2e8c-4ef2-aef1-a16dd02350a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.865070 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781d86-2e8c-4ef2-aef1-a16dd02350a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.865347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781d86-2e8c-4ef2-aef1-a16dd02350a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.865624 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781d86-2e8c-4ef2-aef1-a16dd02350a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.866380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58781d86-2e8c-4ef2-aef1-a16dd02350a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.868094 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58781d86-2e8c-4ef2-aef1-a16dd02350a2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.880963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1376/2804] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:33:48.885668 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b81ecc-28be-48b1-b4bf-d23dc9fb226c admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.904581 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b81ecc-28be-48b1-b4bf-d23dc9fb226c admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.912986 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d05cad-ba6f-47b3-97df-2ecfd1dba902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.914066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d05cad-ba6f-47b3-97df-2ecfd1dba902 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.914710 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d05cad-ba6f-47b3-97df-2ecfd1dba902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.915466 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d05cad-ba6f-47b3-97df-2ecfd1dba902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.916407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d05cad-ba6f-47b3-97df-2ecfd1dba902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.920105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d05cad-ba6f-47b3-97df-2ecfd1dba902 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.944603 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1429/2805] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:48.949479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58781d86-2e8c-4ef2-aef1-a16dd02350a2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.962454 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58781d86-2e8c-4ef2-aef1-a16dd02350a2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.968679 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869f76-4ac2-4bfc-8fb8-c74591003fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.969742 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869f76-4ac2-4bfc-8fb8-c74591003fef admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.970083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869f76-4ac2-4bfc-8fb8-c74591003fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.970441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869f76-4ac2-4bfc-8fb8-c74591003fef admin admin] PATH_INFO: `/v3/projects/f9f4740562784f6099c0d656f1356840/users/3a2287c073c2448d8270a9643859a54c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.992793 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c869f76-4ac2-4bfc-8fb8-c74591003fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f4740562784f6099c0d656f1356840, user_id=3a2287c073c2448d8270a9643859a54c, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.995751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c869f76-4ac2-4bfc-8fb8-c74591003fef admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:49.014248 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1377/2806] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:48 2022] PUT /identity/v3/projects/f9f4740562784f6099c0d656f1356840/users/3a2287c073c2448d8270a9643859a54c/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:49.026564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d160be-0f94-41ba-9791-2b048e0d5eff None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:49.026906 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d160be-0f94-41ba-9791-2b048e0d5eff None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:49.027453 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d160be-0f94-41ba-9791-2b048e0d5eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:49.059936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d2d160be-0f94-41ba-9791-2b048e0d5eff None None] MFA Rules not processed for user `3a2287c073c2448d8270a9643859a54c`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:49.061284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d2d160be-0f94-41ba-9791-2b048e0d5eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:49.151157 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1430/2807] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:49.200057 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869f76-4ac2-4bfc-8fb8-c74591003fef admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:49.202072 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7c869f76-4ac2-4bfc-8fb8-c74591003fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:49.213077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:49.268431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869f76-4ac2-4bfc-8fb8-c74591003fef admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:49.272644 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b219305-ab79-4746-82d2-7c0b0ea11833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:49.273727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b219305-ab79-4746-82d2-7c0b0ea11833 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:49.274066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b219305-ab79-4746-82d2-7c0b0ea11833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:49.274412 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b219305-ab79-4746-82d2-7c0b0ea11833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:49.285489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b219305-ab79-4746-82d2-7c0b0ea11833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:49.287081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b219305-ab79-4746-82d2-7c0b0ea11833 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:49.299205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1378/2808] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:49.315276 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d160be-0f94-41ba-9791-2b048e0d5eff None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:49.398639 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d160be-0f94-41ba-9791-2b048e0d5eff None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:49.410553 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:49.412300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:49.412813 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:49.413136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] PATH_INFO: `/v3/users/3a2287c073c2448d8270a9643859a54c` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:49.414890 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2287c073c2448d8270a9643859a54c)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:49.418238 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:49.502440 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2287c073c2448d8270a9643859a54c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:49.503855 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2287c073c2448d8270a9643859a54c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:49.505028 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2287c073c2448d8270a9643859a54c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:49.507793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:49.540410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2287c073c2448d8270a9643859a54c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:49.553070 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2287c073c2448d8270a9643859a54c'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:49.572728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1431/2809] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:49 2022] DELETE /identity/v3/users/3a2287c073c2448d8270a9643859a54c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:49.577929 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ad201-965f-4682-acf5-911c5bdc8b41 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:49.578370 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ad201-965f-4682-acf5-911c5bdc8b41 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:49.579208 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ad201-965f-4682-acf5-911c5bdc8b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:49.605638 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4b3ad201-965f-4682-acf5-911c5bdc8b41 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:49.607763 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4b3ad201-965f-4682-acf5-911c5bdc8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:49.702725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1379/2810] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:49.715513 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:49.718120 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:49.835528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58cd5c-dead-4645-8c47-615d9a837d05 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:49.839497 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e9561-7288-4441-9333-46ceef085486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:49.840186 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e9561-7288-4441-9333-46ceef085486 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:49.840467 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e9561-7288-4441-9333-46ceef085486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:49.840777 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e9561-7288-4441-9333-46ceef085486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:49.856625 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e9561-7288-4441-9333-46ceef085486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:49.858285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e9561-7288-4441-9333-46ceef085486 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:49.871818 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1432/2811] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:50.257599 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ad201-965f-4682-acf5-911c5bdc8b41 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:50.260646 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4b3ad201-965f-4682-acf5-911c5bdc8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:50.280290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ad201-965f-4682-acf5-911c5bdc8b41 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:50.288703 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:50.290552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:50.290775 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:50.291271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] PATH_INFO: `/v3/projects/f9f4740562784f6099c0d656f1356840` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:50.294356 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f4740562784f6099c0d656f1356840)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:50.298248 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:50.371044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f4740562784f6099c0d656f1356840', 'request_id': 'req-33a7c241-2db7-428a-9037-ef93938df8d6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:50.381429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f4740562784f6099c0d656f1356840', 'request_id': 'req-33a7c241-2db7-428a-9037-ef93938df8d6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:50.391674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f4740562784f6099c0d656f1356840', 'request_id': 'req-33a7c241-2db7-428a-9037-ef93938df8d6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:50.410950 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] The token cache is being invalidate because project f9f4740562784f6099c0d656f1356840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:50.411447 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:50.412653 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-33a7c241-2db7-428a-9037-ef93938df8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:50.415566 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1380/2812] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:50 2022] DELETE /identity/v3/projects/f9f4740562784f6099c0d656f1356840 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:50.424520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8ae88-6f52-4569-b51f-ef6a10c4030e None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:50.425021 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8ae88-6f52-4569-b51f-ef6a10c4030e None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:50.425450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8ae88-6f52-4569-b51f-ef6a10c4030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:50.449688 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d9f8ae88-6f52-4569-b51f-ef6a10c4030e None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:50.451547 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d9f8ae88-6f52-4569-b51f-ef6a10c4030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:50.555410 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1433/2813] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:50.565266 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1665-edcf-4a12-91fd-7aeae52e0b84 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:50.565637 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1665-edcf-4a12-91fd-7aeae52e0b84 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:50.565985 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1665-edcf-4a12-91fd-7aeae52e0b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:50.600106 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-58df1665-edcf-4a12-91fd-7aeae52e0b84 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:50.607770 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-58df1665-edcf-4a12-91fd-7aeae52e0b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:50.633934 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1381/2814] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:50.640388 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8ae88-6f52-4569-b51f-ef6a10c4030e None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:50.660107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8ae88-6f52-4569-b51f-ef6a10c4030e None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:50.671078 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579611b-581b-4fac-a470-85f1bb92b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:50.673822 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579611b-581b-4fac-a470-85f1bb92b14b admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:50.675340 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579611b-581b-4fac-a470-85f1bb92b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:50.676017 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579611b-581b-4fac-a470-85f1bb92b14b admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:50.677579 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579611b-581b-4fac-a470-85f1bb92b14b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:33:50.678322 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579611b-581b-4fac-a470-85f1bb92b14b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:50.681871 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579611b-581b-4fac-a470-85f1bb92b14b admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:50.710559 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1434/2815] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:33:50.717394 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df1665-edcf-4a12-91fd-7aeae52e0b84 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:50.732472 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df1665-edcf-4a12-91fd-7aeae52e0b84 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:50.738426 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c3c61-7557-4233-b338-f7e94cab968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:50.739498 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3c61-7557-4233-b338-f7e94cab968e admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:50.739983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3c61-7557-4233-b338-f7e94cab968e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:50.740423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3c61-7557-4233-b338-f7e94cab968e admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:50.742129 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c3c61-7557-4233-b338-f7e94cab968e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:50.745147 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c3c61-7557-4233-b338-f7e94cab968e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:50.792640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1382/2816] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:50 2022] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:33:50.800282 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579611b-581b-4fac-a470-85f1bb92b14b admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:50.821820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579611b-581b-4fac-a470-85f1bb92b14b admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:50.920281 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:50.941597 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc06e45-5abc-4180-aa2d-1445abc79b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:50.943505 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc06e45-5abc-4180-aa2d-1445abc79b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:50.943724 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc06e45-5abc-4180-aa2d-1445abc79b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:50.944273 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc06e45-5abc-4180-aa2d-1445abc79b03 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:50.945667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc06e45-5abc-4180-aa2d-1445abc79b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:50.953108 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc06e45-5abc-4180-aa2d-1445abc79b03 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:51.009629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1435/2817] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:50 2022] POST /identity/v3/users => generated 282 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:51.010846 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c3c61-7557-4233-b338-f7e94cab968e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:51.025038 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:51.029597 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c3c61-7557-4233-b338-f7e94cab968e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:51.036366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801078e6-9f6f-4859-83e4-78578ed6a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:51.037139 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801078e6-9f6f-4859-83e4-78578ed6a81d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:51.037431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801078e6-9f6f-4859-83e4-78578ed6a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:51.037710 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801078e6-9f6f-4859-83e4-78578ed6a81d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:51.038794 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801078e6-9f6f-4859-83e4-78578ed6a81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:51.041022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801078e6-9f6f-4859-83e4-78578ed6a81d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:51.054952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1383/2818] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:33:51.061079 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc06e45-5abc-4180-aa2d-1445abc79b03 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:51.083258 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc06e45-5abc-4180-aa2d-1445abc79b03 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:51.090707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ac51-eeab-47d2-9d1e-ae3a1e7bc8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:51.091993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ac51-eeab-47d2-9d1e-ae3a1e7bc8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:51.092670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ac51-eeab-47d2-9d1e-ae3a1e7bc8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:51.093134 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ac51-eeab-47d2-9d1e-ae3a1e7bc8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:51.094435 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ac51-eeab-47d2-9d1e-ae3a1e7bc8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:51.097253 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ac51-eeab-47d2-9d1e-ae3a1e7bc8d9 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:51.122215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1436/2819] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:51.126908 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801078e6-9f6f-4859-83e4-78578ed6a81d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:51.138648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801078e6-9f6f-4859-83e4-78578ed6a81d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:51.144568 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb77718-65e3-4b04-ac14-7ce0b63df5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:51.145575 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb77718-65e3-4b04-ac14-7ce0b63df5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:51.145851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb77718-65e3-4b04-ac14-7ce0b63df5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:51.146292 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb77718-65e3-4b04-ac14-7ce0b63df5c3 admin admin] PATH_INFO: `/v3/projects/49e736ab9e184de7a09cbdca837043aa/users/74f5e6a765eb4ad0bf6940cadf75db46/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:51.166256 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb77718-65e3-4b04-ac14-7ce0b63df5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e736ab9e184de7a09cbdca837043aa, user_id=74f5e6a765eb4ad0bf6940cadf75db46, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:51.169314 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb77718-65e3-4b04-ac14-7ce0b63df5c3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:51.194791 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1384/2820] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:51 2022] PUT /identity/v3/projects/49e736ab9e184de7a09cbdca837043aa/users/74f5e6a765eb4ad0bf6940cadf75db46/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:51.208131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204c4e-b213-43f0-a4b1-222b7d2d3664 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:51.208549 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204c4e-b213-43f0-a4b1-222b7d2d3664 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:51.208873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204c4e-b213-43f0-a4b1-222b7d2d3664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:51.252647 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-ef204c4e-b213-43f0-a4b1-222b7d2d3664 None None] MFA Rules not processed for user `74f5e6a765eb4ad0bf6940cadf75db46`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:51.254804 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ef204c4e-b213-43f0-a4b1-222b7d2d3664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:51.394059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1437/2821] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:51.410423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb77718-65e3-4b04-ac14-7ce0b63df5c3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:51.413329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bcb77718-65e3-4b04-ac14-7ce0b63df5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:51.538047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb77718-65e3-4b04-ac14-7ce0b63df5c3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:51.544852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8b254-d6d1-4789-a9d3-2075350d38df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:51.546987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b254-d6d1-4789-a9d3-2075350d38df service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:51.546987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b254-d6d1-4789-a9d3-2075350d38df service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:51.546987 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b254-d6d1-4789-a9d3-2075350d38df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:51.563143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8b254-d6d1-4789-a9d3-2075350d38df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:51.565140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8b254-d6d1-4789-a9d3-2075350d38df service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:51.578193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1385/2822] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:52.621757 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef204c4e-b213-43f0-a4b1-222b7d2d3664 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:52.623545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-ef204c4e-b213-43f0-a4b1-222b7d2d3664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:52.733301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef204c4e-b213-43f0-a4b1-222b7d2d3664 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:52.740429 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:52.741769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:52.742169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:52.742608 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] PATH_INFO: `/v3/users/cc0992805e1d4c2a928ca036a17cb86b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:52.744550 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0992805e1d4c2a928ca036a17cb86b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:52.748004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:52.831919 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0992805e1d4c2a928ca036a17cb86b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:52.832988 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0992805e1d4c2a928ca036a17cb86b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:52.833941 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0992805e1d4c2a928ca036a17cb86b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:52.859411 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0992805e1d4c2a928ca036a17cb86b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:52.862995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:52.875735 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0992805e1d4c2a928ca036a17cb86b'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:52.894144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1438/2823] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:52 2022] DELETE /identity/v3/users/cc0992805e1d4c2a928ca036a17cb86b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:52.899080 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317a0a-c329-465c-acb8-75aac191e100 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:52.899715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317a0a-c329-465c-acb8-75aac191e100 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:52.899715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317a0a-c329-465c-acb8-75aac191e100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:52.920595 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-cd317a0a-c329-465c-acb8-75aac191e100 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:52.921756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cd317a0a-c329-465c-acb8-75aac191e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:52.995130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1386/2824] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:53.006066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:53.007794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:53.108487 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5f8e5-e500-4f3b-85fd-a802f0ff63ad admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:53.114959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf8f7b-b97f-482b-8987-fca106ea8a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:53.116060 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf8f7b-b97f-482b-8987-fca106ea8a30 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:53.116492 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf8f7b-b97f-482b-8987-fca106ea8a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:53.116882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf8f7b-b97f-482b-8987-fca106ea8a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:53.132421 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf8f7b-b97f-482b-8987-fca106ea8a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:53.133957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf8f7b-b97f-482b-8987-fca106ea8a30 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:53.152545 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1439/2825] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:53.596335 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd317a0a-c329-465c-acb8-75aac191e100 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:53.598287 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cd317a0a-c329-465c-acb8-75aac191e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:53.628097 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd317a0a-c329-465c-acb8-75aac191e100 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:53.636157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:53.638851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:53.638851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:53.638851 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] PATH_INFO: `/v3/projects/47fea2bbb4f9439d93786a9c57c2ff22` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:53.641083 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47fea2bbb4f9439d93786a9c57c2ff22)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:53.644761 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:53.734995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47fea2bbb4f9439d93786a9c57c2ff22', 'request_id': 'req-4682d3bb-0299-48af-998f-c2a76cf9b063'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:53.745346 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47fea2bbb4f9439d93786a9c57c2ff22', 'request_id': 'req-4682d3bb-0299-48af-998f-c2a76cf9b063'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:53.758937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47fea2bbb4f9439d93786a9c57c2ff22', 'request_id': 'req-4682d3bb-0299-48af-998f-c2a76cf9b063'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:53.764924 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:53.783407 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] The token cache is being invalidate because project 47fea2bbb4f9439d93786a9c57c2ff22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:53.783780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:53.784783 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:53.787046 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1387/2826] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:53 2022] DELETE /identity/v3/projects/47fea2bbb4f9439d93786a9c57c2ff22 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:53.791646 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf8f7b-b97f-482b-8987-fca106ea8a30 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:53.805040 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf8f7b-b97f-482b-8987-fca106ea8a30 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:53.911033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:53.912169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:53.912623 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:53.913097 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] PATH_INFO: `/v3/users/7415472ad7f048d984513912529a8f03` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:53.914841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7415472ad7f048d984513912529a8f03)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:53.917431 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:53.977635 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7415472ad7f048d984513912529a8f03'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:53.978332 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7415472ad7f048d984513912529a8f03'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:53.979004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7415472ad7f048d984513912529a8f03'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:53.994900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7415472ad7f048d984513912529a8f03'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:54.004758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-2cf21b26-4e46-43ca-8669-f8401dbe8ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7415472ad7f048d984513912529a8f03'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:54.020125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1440/2827] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:53 2022] DELETE /identity/v3/users/7415472ad7f048d984513912529a8f03 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:33:54.385169 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:54.386099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:54.409655 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d3bb-0299-48af-998f-c2a76cf9b063 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:54.522984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:54.524578 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:54.524978 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:54.525487 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] PATH_INFO: `/v3/projects/a47d4c657bf8478491888909181369e9` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:54.527923 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47d4c657bf8478491888909181369e9)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:54.532331 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:54.613668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47d4c657bf8478491888909181369e9', 'request_id': 'req-f3c745d8-d1af-4e88-b981-1a93bea54b3d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:54.624937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47d4c657bf8478491888909181369e9', 'request_id': 'req-f3c745d8-d1af-4e88-b981-1a93bea54b3d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:54.636904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47d4c657bf8478491888909181369e9', 'request_id': 'req-f3c745d8-d1af-4e88-b981-1a93bea54b3d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:54.658452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] The token cache is being invalidate because project a47d4c657bf8478491888909181369e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:54.658916 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:54.659863 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f3c745d8-d1af-4e88-b981-1a93bea54b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:54.661865 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1388/2828] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:54 2022] DELETE /identity/v3/projects/a47d4c657bf8478491888909181369e9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:54.668698 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51811676-ca4f-4442-8751-5b6bd23d8deb None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:54.668990 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51811676-ca4f-4442-8751-5b6bd23d8deb None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:54.669329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51811676-ca4f-4442-8751-5b6bd23d8deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:54.680937 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:54.698335 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-51811676-ca4f-4442-8751-5b6bd23d8deb None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:54.700878 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-51811676-ca4f-4442-8751-5b6bd23d8deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:54.785154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1441/2829] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:54.794683 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48f1a7-fa1c-446d-95c4-856331ae163b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:54.795143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48f1a7-fa1c-446d-95c4-856331ae163b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:54.795571 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48f1a7-fa1c-446d-95c4-856331ae163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:54.817871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6a48f1a7-fa1c-446d-95c4-856331ae163b None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:54.819182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6a48f1a7-fa1c-446d-95c4-856331ae163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:54.830961 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1389/2830] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:54.837369 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51811676-ca4f-4442-8751-5b6bd23d8deb None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:54.860277 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51811676-ca4f-4442-8751-5b6bd23d8deb None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:54.871016 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcbdc7-e099-4302-9807-de78012cbede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:54.872172 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcbdc7-e099-4302-9807-de78012cbede admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:54.872669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcbdc7-e099-4302-9807-de78012cbede admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:54.873163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcbdc7-e099-4302-9807-de78012cbede admin admin] PATH_INFO: `/v3/domains` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:54.874552 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcbdc7-e099-4302-9807-de78012cbede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:33:54.875134 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcbdc7-e099-4302-9807-de78012cbede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:54.878371 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcbdc7-e099-4302-9807-de78012cbede admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:54.904424 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1442/2831] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:33:54.908300 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48f1a7-fa1c-446d-95c4-856331ae163b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:54.923269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48f1a7-fa1c-446d-95c4-856331ae163b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:54.928982 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1d84e-651e-4111-a0e0-f616a3ce5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:54.929954 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1d84e-651e-4111-a0e0-f616a3ce5848 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:54.930391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1d84e-651e-4111-a0e0-f616a3ce5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:54.930774 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1d84e-651e-4111-a0e0-f616a3ce5848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:54.931567 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1d84e-651e-4111-a0e0-f616a3ce5848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:54.935623 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1d84e-651e-4111-a0e0-f616a3ce5848 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:54.981560 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1390/2832] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:54 2022] POST /identity/v3/projects => generated 407 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:33:54.984147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcbdc7-e099-4302-9807-de78012cbede admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:55.001811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcbdc7-e099-4302-9807-de78012cbede admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:55.105907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608d783-b21c-411d-8a6c-d41e16f50408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:55.107110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608d783-b21c-411d-8a6c-d41e16f50408 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:55.107373 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608d783-b21c-411d-8a6c-d41e16f50408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:55.107728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608d783-b21c-411d-8a6c-d41e16f50408 admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:55.108630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608d783-b21c-411d-8a6c-d41e16f50408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:55.111001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608d783-b21c-411d-8a6c-d41e16f50408 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:55.142640 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1443/2833] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:54 2022] POST /identity/v3/users => generated 304 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:55.148992 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1d84e-651e-4111-a0e0-f616a3ce5848 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:55.163028 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1d84e-651e-4111-a0e0-f616a3ce5848 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:55.168833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9167b98-ad80-4cc9-b84b-9b1ec789d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:55.169541 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9167b98-ad80-4cc9-b84b-9b1ec789d602 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:55.169817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9167b98-ad80-4cc9-b84b-9b1ec789d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:55.170089 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9167b98-ad80-4cc9-b84b-9b1ec789d602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:55.170904 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9167b98-ad80-4cc9-b84b-9b1ec789d602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:55.172538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9167b98-ad80-4cc9-b84b-9b1ec789d602 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:55.185345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1391/2834] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:33:55.198734 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608d783-b21c-411d-8a6c-d41e16f50408 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:55.207548 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608d783-b21c-411d-8a6c-d41e16f50408 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:55.212588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cffc68-8527-412f-833c-e76b3be56829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:55.213297 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffc68-8527-412f-833c-e76b3be56829 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:55.213581 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffc68-8527-412f-833c-e76b3be56829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:55.213862 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffc68-8527-412f-833c-e76b3be56829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:55.214667 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cffc68-8527-412f-833c-e76b3be56829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:55.216508 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cffc68-8527-412f-833c-e76b3be56829 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:55.228356 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1444/2835] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:55.234111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9167b98-ad80-4cc9-b84b-9b1ec789d602 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:55.252284 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9167b98-ad80-4cc9-b84b-9b1ec789d602 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:55.260944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466f72-0434-40c0-bad2-bdd068edb29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:55.262582 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466f72-0434-40c0-bad2-bdd068edb29a admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:55.263090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466f72-0434-40c0-bad2-bdd068edb29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:55.263587 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466f72-0434-40c0-bad2-bdd068edb29a admin admin] PATH_INFO: `/v3/projects/ff536d5fd5594792a2149b32e8587229/users/65b41c853a09442e8be59ea5fe240a75/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:55.292849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36466f72-0434-40c0-bad2-bdd068edb29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff536d5fd5594792a2149b32e8587229, user_id=65b41c853a09442e8be59ea5fe240a75, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:55.298449 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36466f72-0434-40c0-bad2-bdd068edb29a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:55.322335 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1392/2836] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:55 2022] PUT /identity/v3/projects/ff536d5fd5594792a2149b32e8587229/users/65b41c853a09442e8be59ea5fe240a75/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:55.334851 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e04a9-3d09-46ee-aab6-d626c6cd6b93 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:55.335563 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e04a9-3d09-46ee-aab6-d626c6cd6b93 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:55.335936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e04a9-3d09-46ee-aab6-d626c6cd6b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:55.370598 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-326e04a9-3d09-46ee-aab6-d626c6cd6b93 None None] MFA Rules not processed for user `65b41c853a09442e8be59ea5fe240a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:55.372127 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-326e04a9-3d09-46ee-aab6-d626c6cd6b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:55.454354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:55.459989 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1445/2837] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:55.465834 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466f72-0434-40c0-bad2-bdd068edb29a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:55.501730 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:55.552505 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466f72-0434-40c0-bad2-bdd068edb29a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:55.558468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8a2f8-4f95-4c34-9101-edf809e1ac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:55.559203 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a2f8-4f95-4c34-9101-edf809e1ac6d admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:55.559456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a2f8-4f95-4c34-9101-edf809e1ac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:55.559755 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a2f8-4f95-4c34-9101-edf809e1ac6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:55.560477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8a2f8-4f95-4c34-9101-edf809e1ac6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:55.562437 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8a2f8-4f95-4c34-9101-edf809e1ac6d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:55.592575 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1393/2838] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:55 2022] POST /identity/v3/projects => generated 407 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:33:55.598103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e04a9-3d09-46ee-aab6-d626c6cd6b93 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:55.617742 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e04a9-3d09-46ee-aab6-d626c6cd6b93 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:55.713571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d32dcd-ed87-4685-ac47-63ac4ae2b9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:55.714355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32dcd-ed87-4685-ac47-63ac4ae2b9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:55.714723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32dcd-ed87-4685-ac47-63ac4ae2b9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:55.715068 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32dcd-ed87-4685-ac47-63ac4ae2b9ca admin admin] PATH_INFO: `/v3/users` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:55.716338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d32dcd-ed87-4685-ac47-63ac4ae2b9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:55.719992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d32dcd-ed87-4685-ac47-63ac4ae2b9ca admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:55.748911 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1446/2839] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:55 2022] POST /identity/v3/users => generated 310 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:33:55.753602 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8a2f8-4f95-4c34-9101-edf809e1ac6d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:55.765563 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8a2f8-4f95-4c34-9101-edf809e1ac6d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:55.771077 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b55e-aa68-4037-b953-e17f14f60234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:55.771844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b55e-aa68-4037-b953-e17f14f60234 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:55.772253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b55e-aa68-4037-b953-e17f14f60234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:55.772665 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b55e-aa68-4037-b953-e17f14f60234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:55.773620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b55e-aa68-4037-b953-e17f14f60234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:55.775456 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b55e-aa68-4037-b953-e17f14f60234 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:55.789109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1394/2840] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:55.793959 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d32dcd-ed87-4685-ac47-63ac4ae2b9ca admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:55.807314 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d32dcd-ed87-4685-ac47-63ac4ae2b9ca admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:55.814135 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8141eda-6324-43ee-97b8-c13c26c00483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:55.815670 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8141eda-6324-43ee-97b8-c13c26c00483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:55.815957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8141eda-6324-43ee-97b8-c13c26c00483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:55.816233 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8141eda-6324-43ee-97b8-c13c26c00483 admin admin] PATH_INFO: `/v3/projects/89d84e2726b24622a723bbf9b73ca3d2/users/78f8c69d1e264877a7b4bd4fd4769f1a/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:55.842675 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8141eda-6324-43ee-97b8-c13c26c00483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d84e2726b24622a723bbf9b73ca3d2, user_id=78f8c69d1e264877a7b4bd4fd4769f1a, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:55.847891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8141eda-6324-43ee-97b8-c13c26c00483 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:55.868161 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1447/2841] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:55 2022] PUT /identity/v3/projects/89d84e2726b24622a723bbf9b73ca3d2/users/78f8c69d1e264877a7b4bd4fd4769f1a/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:55.872816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b55e-aa68-4037-b953-e17f14f60234 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:55.885179 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b55e-aa68-4037-b953-e17f14f60234 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:55.975387 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cb257-b226-4354-be89-fb9142fecd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:55.976802 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb257-b226-4354-be89-fb9142fecd89 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:55.977329 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb257-b226-4354-be89-fb9142fecd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:55.977836 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb257-b226-4354-be89-fb9142fecd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:55.979400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cb257-b226-4354-be89-fb9142fecd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:55.982244 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cb257-b226-4354-be89-fb9142fecd89 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:55.995523 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1395/2842] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:56.000463 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8141eda-6324-43ee-97b8-c13c26c00483 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:56.011916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8141eda-6324-43ee-97b8-c13c26c00483 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:56.017117 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5da5c-4974-4c4b-be86-bbdb2f291503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:56.018057 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5da5c-4974-4c4b-be86-bbdb2f291503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:56.018337 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5da5c-4974-4c4b-be86-bbdb2f291503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:56.018651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5da5c-4974-4c4b-be86-bbdb2f291503 admin admin] PATH_INFO: `/v3/projects/89d84e2726b24622a723bbf9b73ca3d2/users/78f8c69d1e264877a7b4bd4fd4769f1a/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:56.020845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5da5c-4974-4c4b-be86-bbdb2f291503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d84e2726b24622a723bbf9b73ca3d2, user_id=78f8c69d1e264877a7b4bd4fd4769f1a, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:56.023644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5da5c-4974-4c4b-be86-bbdb2f291503 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:56.036867 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1448/2843] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:55 2022] PUT /identity/v3/projects/89d84e2726b24622a723bbf9b73ca3d2/users/78f8c69d1e264877a7b4bd4fd4769f1a/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:56.048086 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26d8b1-e03b-4522-a8a9-d7b353985a4b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:56.048484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26d8b1-e03b-4522-a8a9-d7b353985a4b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:56.048805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26d8b1-e03b-4522-a8a9-d7b353985a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:56.084890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5b26d8b1-e03b-4522-a8a9-d7b353985a4b None None] MFA Rules not processed for user `78f8c69d1e264877a7b4bd4fd4769f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:56.086062 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5b26d8b1-e03b-4522-a8a9-d7b353985a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:56.178768 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1396/2844] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:33:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:33:56.195803 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5da5c-4974-4c4b-be86-bbdb2f291503 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:56.197793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-efe5da5c-4974-4c4b-be86-bbdb2f291503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:56.286833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5da5c-4974-4c4b-be86-bbdb2f291503 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:56.291824 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21131b6-c8a9-4b17-a5bc-02f2561a40b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:56.292684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21131b6-c8a9-4b17-a5bc-02f2561a40b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:56.293073 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21131b6-c8a9-4b17-a5bc-02f2561a40b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:56.293451 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21131b6-c8a9-4b17-a5bc-02f2561a40b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:56.306928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21131b6-c8a9-4b17-a5bc-02f2561a40b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:56.309268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21131b6-c8a9-4b17-a5bc-02f2561a40b8 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:56.326584 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1449/2845] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:56.560336 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26d8b1-e03b-4522-a8a9-d7b353985a4b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:56.572195 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26d8b1-e03b-4522-a8a9-d7b353985a4b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:56.577115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f634836-bbc4-4de7-ae01-f0569d0ab2ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:56.577756 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f634836-bbc4-4de7-ae01-f0569d0ab2ba service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:56.578030 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f634836-bbc4-4de7-ae01-f0569d0ab2ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:56.578299 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f634836-bbc4-4de7-ae01-f0569d0ab2ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:56.596405 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:56.654546 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f634836-bbc4-4de7-ae01-f0569d0ab2ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:56.656036 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f634836-bbc4-4de7-ae01-f0569d0ab2ba service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:56.666750 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1397/2846] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:34:06.317789 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=70,keystone:INSERT=5 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:06.662005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=20 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:07.113841 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21131b6-c8a9-4b17-a5bc-02f2561a40b8 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:07.115823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a21131b6-c8a9-4b17-a5bc-02f2561a40b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:07.198004 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21131b6-c8a9-4b17-a5bc-02f2561a40b8 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:07.202701 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128cd38-2e8b-4c06-b6e1-39a6e1096340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:07.203389 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128cd38-2e8b-4c06-b6e1-39a6e1096340 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:07.203678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128cd38-2e8b-4c06-b6e1-39a6e1096340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:07.203960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128cd38-2e8b-4c06-b6e1-39a6e1096340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:07.206197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4128cd38-2e8b-4c06-b6e1-39a6e1096340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:07.304015 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128cd38-2e8b-4c06-b6e1-39a6e1096340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:07.305708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128cd38-2e8b-4c06-b6e1-39a6e1096340 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:07.316916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1450/2847] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:34:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:34:08.508156 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f634836-bbc4-4de7-ae01-f0569d0ab2ba service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:08.585019 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f634836-bbc4-4de7-ae01-f0569d0ab2ba service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:08.590866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:08.591853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:08.592140 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:08.592417 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] PATH_INFO: `/v3/users/65b41c853a09442e8be59ea5fe240a75` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:08.593824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b41c853a09442e8be59ea5fe240a75)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:08.595874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:08.670005 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b41c853a09442e8be59ea5fe240a75'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:08.680441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b41c853a09442e8be59ea5fe240a75'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:08.681211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b41c853a09442e8be59ea5fe240a75'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:08.700002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b41c853a09442e8be59ea5fe240a75'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:08.712514 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b41c853a09442e8be59ea5fe240a75'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:08.720255 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1398/2848] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:34:08 2022] DELETE /identity/v3/users/65b41c853a09442e8be59ea5fe240a75 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:34:08.726272 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534675b8-5160-4c05-9fef-0e3dadcbc82c None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:08.727247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534675b8-5160-4c05-9fef-0e3dadcbc82c None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:08.727247 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534675b8-5160-4c05-9fef-0e3dadcbc82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:08.764012 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-534675b8-5160-4c05-9fef-0e3dadcbc82c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:34:08.766095 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-534675b8-5160-4c05-9fef-0e3dadcbc82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:08.866148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1451/2849] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:34:08.876230 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:08.877979 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:08.981297 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f9782-3a16-41e3-be6f-131c24b19f2e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:08.988524 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaca098-9bd9-4c99-9e1e-9abbe2f0e29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:08.989193 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaca098-9bd9-4c99-9e1e-9abbe2f0e29d service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:08.989481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaca098-9bd9-4c99-9e1e-9abbe2f0e29d service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:08.989754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaca098-9bd9-4c99-9e1e-9abbe2f0e29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:09.007251 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaca098-9bd9-4c99-9e1e-9abbe2f0e29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:09.010053 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaca098-9bd9-4c99-9e1e-9abbe2f0e29d service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:09.027792 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1399/2850] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:34:09.431786 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534675b8-5160-4c05-9fef-0e3dadcbc82c None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:09.433510 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-534675b8-5160-4c05-9fef-0e3dadcbc82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:09.447538 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534675b8-5160-4c05-9fef-0e3dadcbc82c None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:09.455136 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:09.456534 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:09.458218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:09.459472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] PATH_INFO: `/v3/projects/ff536d5fd5594792a2149b32e8587229` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:09.461330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff536d5fd5594792a2149b32e8587229)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:09.465900 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:09.569246 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:09.576691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff536d5fd5594792a2149b32e8587229', 'request_id': 'req-bc8fb724-51bb-4709-9bce-48e504c0e012'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:09.589303 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff536d5fd5594792a2149b32e8587229', 'request_id': 'req-bc8fb724-51bb-4709-9bce-48e504c0e012'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:09.599770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff536d5fd5594792a2149b32e8587229', 'request_id': 'req-bc8fb724-51bb-4709-9bce-48e504c0e012'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:09.623107 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] The token cache is being invalidate because project ff536d5fd5594792a2149b32e8587229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:34:09.624071 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:09.624883 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:09.626551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1452/2851] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:34:09 2022] DELETE /identity/v3/projects/ff536d5fd5594792a2149b32e8587229 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:34:09.632434 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaca098-9bd9-4c99-9e1e-9abbe2f0e29d service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:09.648316 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaca098-9bd9-4c99-9e1e-9abbe2f0e29d service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:09.675737 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:09.766347 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:09.768296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:09.768879 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:09.769490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] PATH_INFO: `/v3/users/78f8c69d1e264877a7b4bd4fd4769f1a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:09.772635 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f8c69d1e264877a7b4bd4fd4769f1a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:09.777167 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:09.899040 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f8c69d1e264877a7b4bd4fd4769f1a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:09.913727 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f8c69d1e264877a7b4bd4fd4769f1a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:09.915441 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f8c69d1e264877a7b4bd4fd4769f1a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:09.943265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f8c69d1e264877a7b4bd4fd4769f1a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:09.964473 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f8c69d1e264877a7b4bd4fd4769f1a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:09.974751 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1400/2852] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:34:09 2022] DELETE /identity/v3/users/78f8c69d1e264877a7b4bd4fd4769f1a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:34:10.497420 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:10.499561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:10.536360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fb724-51bb-4709-9bce-48e504c0e012 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:10.669865 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:10.671626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:10.672251 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:10.672783 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] PATH_INFO: `/v3/projects/89d84e2726b24622a723bbf9b73ca3d2` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:10.676745 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d84e2726b24622a723bbf9b73ca3d2)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:10.681159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:10.779227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d84e2726b24622a723bbf9b73ca3d2', 'request_id': 'req-6d99b05b-855e-431f-8563-aa5cdb86f6c1'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:10.795412 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d84e2726b24622a723bbf9b73ca3d2', 'request_id': 'req-6d99b05b-855e-431f-8563-aa5cdb86f6c1'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:10.815376 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d84e2726b24622a723bbf9b73ca3d2', 'request_id': 'req-6d99b05b-855e-431f-8563-aa5cdb86f6c1'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:10.849402 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] The token cache is being invalidate because project 89d84e2726b24622a723bbf9b73ca3d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:34:10.850030 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:10.851061 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-6d99b05b-855e-431f-8563-aa5cdb86f6c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:10.854001 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1453/2853] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:34:10 2022] DELETE /identity/v3/projects/89d84e2726b24622a723bbf9b73ca3d2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:34:19.969042 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:20.840897 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:DELETE=11,keystone:SELECT=58,keystone:INSERT=2 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:42.285249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:42.287598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:42.311553 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff082b9-f669-4505-83e7-8b16bd952e62 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:42.415037 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:42.416228 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:42.416499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:42.416785 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] PATH_INFO: `/v3/users/74f5e6a765eb4ad0bf6940cadf75db46` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:42.418235 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f5e6a765eb4ad0bf6940cadf75db46)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:42.420294 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:42.483090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f5e6a765eb4ad0bf6940cadf75db46'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:42.493468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f5e6a765eb4ad0bf6940cadf75db46'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:42.494223 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f5e6a765eb4ad0bf6940cadf75db46'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:42.509391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f5e6a765eb4ad0bf6940cadf75db46'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:42.519630 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f5e6a765eb4ad0bf6940cadf75db46'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:42.527245 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1401/2854] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:34:42 2022] DELETE /identity/v3/users/74f5e6a765eb4ad0bf6940cadf75db46 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:34:42.532740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0f07d-eace-4c75-8475-9b3bf0a2b6cd None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:42.533367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0f07d-eace-4c75-8475-9b3bf0a2b6cd None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:42.533367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0f07d-eace-4c75-8475-9b3bf0a2b6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:42.557341 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-3ee0f07d-eace-4c75-8475-9b3bf0a2b6cd None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:34:42.558904 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3ee0f07d-eace-4c75-8475-9b3bf0a2b6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:42.634231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1454/2855] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:34:42.646776 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:42.648489 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:42.718414 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede041a-29da-46fc-a5ad-92ddb1d0f855 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:42.723271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b446c5-41af-4a35-a13d-fb3ce449e50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:42.723958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b446c5-41af-4a35-a13d-fb3ce449e50d service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:42.724262 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b446c5-41af-4a35-a13d-fb3ce449e50d service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:42.724532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b446c5-41af-4a35-a13d-fb3ce449e50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:42.736296 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b446c5-41af-4a35-a13d-fb3ce449e50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:42.737793 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b446c5-41af-4a35-a13d-fb3ce449e50d service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:42.749211 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1402/2856] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:34:43.072576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0f07d-eace-4c75-8475-9b3bf0a2b6cd None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:43.074316 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-3ee0f07d-eace-4c75-8475-9b3bf0a2b6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:43.087400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0f07d-eace-4c75-8475-9b3bf0a2b6cd None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:43.092532 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:43.093447 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.093728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.094007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] PATH_INFO: `/v3/projects/49e736ab9e184de7a09cbdca837043aa` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.095379 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e736ab9e184de7a09cbdca837043aa)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:43.097338 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:43.159158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e736ab9e184de7a09cbdca837043aa', 'request_id': 'req-88957df0-abf0-4639-8de9-78a2fb47dce6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:43.169699 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e736ab9e184de7a09cbdca837043aa', 'request_id': 'req-88957df0-abf0-4639-8de9-78a2fb47dce6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:43.177798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e736ab9e184de7a09cbdca837043aa', 'request_id': 'req-88957df0-abf0-4639-8de9-78a2fb47dce6'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:43.191403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] The token cache is being invalidate because project 49e736ab9e184de7a09cbdca837043aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:34:43.191886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:43.192728 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-88957df0-abf0-4639-8de9-78a2fb47dce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:34:43.194472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1455/2857] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:34:43 2022] DELETE /identity/v3/projects/49e736ab9e184de7a09cbdca837043aa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:34:43.199993 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c298e-0336-4be3-915b-145eea4e4e7c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.200333 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c298e-0336-4be3-915b-145eea4e4e7c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.200725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c298e-0336-4be3-915b-145eea4e4e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.220113 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a70c298e-0336-4be3-915b-145eea4e4e7c None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:34:43.221499 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a70c298e-0336-4be3-915b-145eea4e4e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:43.241429 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:43.296573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1403/2858] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:34:43.305796 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2a6f-9344-4824-9dcb-7c2e883a6771 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.306089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2a6f-9344-4824-9dcb-7c2e883a6771 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.306328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2a6f-9344-4824-9dcb-7c2e883a6771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.326982 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-d26d2a6f-9344-4824-9dcb-7c2e883a6771 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:34:43.328223 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d26d2a6f-9344-4824-9dcb-7c2e883a6771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:43.337142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1456/2859] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:34:43.342102 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c298e-0336-4be3-915b-145eea4e4e7c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:43.352893 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c298e-0336-4be3-915b-145eea4e4e7c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:43.358643 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1067-2b03-4a92-a4e7-65086fce1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:43.359337 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1067-2b03-4a92-a4e7-65086fce1467 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.359617 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1067-2b03-4a92-a4e7-65086fce1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.359892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1067-2b03-4a92-a4e7-65086fce1467 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.360762 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d1067-2b03-4a92-a4e7-65086fce1467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:34:43.360969 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d1067-2b03-4a92-a4e7-65086fce1467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:43.362681 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d1067-2b03-4a92-a4e7-65086fce1467 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:43.376345 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1404/2860] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:34:43.381147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2a6f-9344-4824-9dcb-7c2e883a6771 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:43.391589 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2a6f-9344-4824-9dcb-7c2e883a6771 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:43.396873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5cdfd-3040-4c56-b014-1a87a882ee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:43.397633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5cdfd-3040-4c56-b014-1a87a882ee84 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.397957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5cdfd-3040-4c56-b014-1a87a882ee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.398268 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5cdfd-3040-4c56-b014-1a87a882ee84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.399069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5cdfd-3040-4c56-b014-1a87a882ee84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:43.401067 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5cdfd-3040-4c56-b014-1a87a882ee84 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:43.432663 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1457/2861] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:34:43 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:34:43.437674 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1067-2b03-4a92-a4e7-65086fce1467 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:43.450105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1067-2b03-4a92-a4e7-65086fce1467 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:43.519482 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645ec8a-07e4-4dac-b047-a36613fd8aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:43.520180 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ec8a-07e4-4dac-b047-a36613fd8aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.520460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ec8a-07e4-4dac-b047-a36613fd8aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.520741 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ec8a-07e4-4dac-b047-a36613fd8aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.521452 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645ec8a-07e4-4dac-b047-a36613fd8aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:43.523478 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645ec8a-07e4-4dac-b047-a36613fd8aa7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:43.547483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1405/2862] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:34:43 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:34:43.554996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5cdfd-3040-4c56-b014-1a87a882ee84 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:43.567158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5cdfd-3040-4c56-b014-1a87a882ee84 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:43.573740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d424b-8788-4937-8eb2-67924345fcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:43.574629 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d424b-8788-4937-8eb2-67924345fcaf admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.574912 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d424b-8788-4937-8eb2-67924345fcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.575190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d424b-8788-4937-8eb2-67924345fcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.575957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d424b-8788-4937-8eb2-67924345fcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:43.577617 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d424b-8788-4937-8eb2-67924345fcaf admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:43.590674 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1458/2863] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:34:43.595246 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645ec8a-07e4-4dac-b047-a36613fd8aa7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:43.607214 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645ec8a-07e4-4dac-b047-a36613fd8aa7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:43.613819 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c580-5ad9-4612-9ba1-cfe96ec8e12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:43.614427 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c580-5ad9-4612-9ba1-cfe96ec8e12a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.614739 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c580-5ad9-4612-9ba1-cfe96ec8e12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.615009 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c580-5ad9-4612-9ba1-cfe96ec8e12a admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.615749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631c580-5ad9-4612-9ba1-cfe96ec8e12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:43.617391 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631c580-5ad9-4612-9ba1-cfe96ec8e12a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:43.629432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1406/2864] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:34:43.636363 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d424b-8788-4937-8eb2-67924345fcaf admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:43.655142 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d424b-8788-4937-8eb2-67924345fcaf admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:43.663917 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a152dee-b43d-49ea-946e-59b13689953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:43.665530 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152dee-b43d-49ea-946e-59b13689953e admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.666011 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152dee-b43d-49ea-946e-59b13689953e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.666528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152dee-b43d-49ea-946e-59b13689953e admin admin] PATH_INFO: `/v3/projects/cc445d96f85d4cf49747bf592ad9d26b/users/004ddfdfeb7f4151bc84f166638123e4/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.695465 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a152dee-b43d-49ea-946e-59b13689953e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc445d96f85d4cf49747bf592ad9d26b, user_id=004ddfdfeb7f4151bc84f166638123e4, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:43.700567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a152dee-b43d-49ea-946e-59b13689953e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:43.727275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1459/2865] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:34:43 2022] PUT /identity/v3/projects/cc445d96f85d4cf49747bf592ad9d26b/users/004ddfdfeb7f4151bc84f166638123e4/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:34:43.734754 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef40e-0202-4dcc-8546-e480c39e4c72 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.735096 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef40e-0202-4dcc-8546-e480c39e4c72 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.735423 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef40e-0202-4dcc-8546-e480c39e4c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.755974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-426ef40e-0202-4dcc-8546-e480c39e4c72 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:34:43.757690 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-426ef40e-0202-4dcc-8546-e480c39e4c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:43.833974 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1407/2866] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:34:43.844905 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a152dee-b43d-49ea-946e-59b13689953e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:43.846995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1a152dee-b43d-49ea-946e-59b13689953e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:43.873853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:43.918215 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a152dee-b43d-49ea-946e-59b13689953e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:43.922912 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694efcc-2bfb-466b-8131-889ecca298ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:43.923583 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694efcc-2bfb-466b-8131-889ecca298ab service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:43.923875 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694efcc-2bfb-466b-8131-889ecca298ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:43.924154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694efcc-2bfb-466b-8131-889ecca298ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:43.935626 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694efcc-2bfb-466b-8131-889ecca298ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:43.937137 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694efcc-2bfb-466b-8131-889ecca298ab service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:43.948914 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1460/2867] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:34:44.698539 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330ace6-83b7-4be6-9850-adee1784aa8c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:44.699432 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330ace6-83b7-4be6-9850-adee1784aa8c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:44.700398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330ace6-83b7-4be6-9850-adee1784aa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:44.734632 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d330ace6-83b7-4be6-9850-adee1784aa8c None None] MFA Rules not processed for user `004ddfdfeb7f4151bc84f166638123e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:34:44.735845 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d330ace6-83b7-4be6-9850-adee1784aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:44.756771 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:44.832025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1408/2868] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:34:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:34:44.844520 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694efcc-2bfb-466b-8131-889ecca298ab service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:44.846907 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-b694efcc-2bfb-466b-8131-889ecca298ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:44.962794 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694efcc-2bfb-466b-8131-889ecca298ab service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:44.966820 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99680209-0ab0-4f2b-8001-ce3d19524050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748ece05182480f90a70dc587f2a007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:44.967488 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680209-0ab0-4f2b-8001-ce3d19524050 service cinder] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:44.967769 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680209-0ab0-4f2b-8001-ce3d19524050 service cinder] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:44.968039 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680209-0ab0-4f2b-8001-ce3d19524050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:44.978069 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99680209-0ab0-4f2b-8001-ce3d19524050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:44.979578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99680209-0ab0-4f2b-8001-ce3d19524050 service cinder] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:44.990889 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1461/2869] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:34:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:34:46.396133 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2999f2-ea01-4e1f-b196-b507435c335b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:46.396735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2999f2-ea01-4e1f-b196-b507435c335b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:46.396735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2999f2-ea01-4e1f-b196-b507435c335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:46.417376 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1c2999f2-ea01-4e1f-b196-b507435c335b None None] MFA Rules not processed for user `004ddfdfeb7f4151bc84f166638123e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:34:46.418767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1c2999f2-ea01-4e1f-b196-b507435c335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:46.428039 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1409/2870] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:34:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:34:47.001105 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99680209-0ab0-4f2b-8001-ce3d19524050 service cinder] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:47.002882 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-99680209-0ab0-4f2b-8001-ce3d19524050 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:47.016993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99680209-0ab0-4f2b-8001-ce3d19524050 service cinder] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:47.022320 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c40d-d45e-40cc-bc81-72e03217613c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:47.023052 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c40d-d45e-40cc-bc81-72e03217613c service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:47.023336 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c40d-d45e-40cc-bc81-72e03217613c service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:47.023609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c40d-d45e-40cc-bc81-72e03217613c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:47.025939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a449c40d-d45e-40cc-bc81-72e03217613c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:47.038481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c40d-d45e-40cc-bc81-72e03217613c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:47.040018 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c40d-d45e-40cc-bc81-72e03217613c service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:47.049817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1462/2871] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:34:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:34:56.411931 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=22 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:57.047567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=58 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:33.415034 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2999f2-ea01-4e1f-b196-b507435c335b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:33.428648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2999f2-ea01-4e1f-b196-b507435c335b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:33.436182 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f2354-3812-41b2-91e3-d85cc07a4762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:33.437424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f2354-3812-41b2-91e3-d85cc07a4762 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:33.437984 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f2354-3812-41b2-91e3-d85cc07a4762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:33.438462 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f2354-3812-41b2-91e3-d85cc07a4762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:33.442109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-193f2354-3812-41b2-91e3-d85cc07a4762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:33.611162 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f2354-3812-41b2-91e3-d85cc07a4762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:33.612880 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f2354-3812-41b2-91e3-d85cc07a4762 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:33.650580 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1410/2872] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:34.946426 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c40d-d45e-40cc-bc81-72e03217613c service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:34.957651 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c40d-d45e-40cc-bc81-72e03217613c service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:34.962327 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9a93-f646-4c54-b0c7-c82f25965a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:34.963231 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9a93-f646-4c54-b0c7-c82f25965a14 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:34.963700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9a93-f646-4c54-b0c7-c82f25965a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:34.964317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9a93-f646-4c54-b0c7-c82f25965a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:34.967048 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e25b9a93-f646-4c54-b0c7-c82f25965a14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:34.987163 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b9a93-f646-4c54-b0c7-c82f25965a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:34.988660 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b9a93-f646-4c54-b0c7-c82f25965a14 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:35.002311 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1463/2873] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:35:43.644993 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=46 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:44.996226 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=6 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:04.162839 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177979-b2a6-447e-92b0-f517b76b21b0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:04.163509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177979-b2a6-447e-92b0-f517b76b21b0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:04.163509 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177979-b2a6-447e-92b0-f517b76b21b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:04.183419 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-82177979-b2a6-447e-92b0-f517b76b21b0 None None] MFA Rules not processed for user `004ddfdfeb7f4151bc84f166638123e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:04.184874 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-82177979-b2a6-447e-92b0-f517b76b21b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:04.194289 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1411/2874] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:36:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:36:04.855407 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9a93-f646-4c54-b0c7-c82f25965a14 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:04.857816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e25b9a93-f646-4c54-b0c7-c82f25965a14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:04.958480 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9a93-f646-4c54-b0c7-c82f25965a14 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:04.964853 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecf2f4-b283-4b6a-8a08-aab819787ec4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:04.965560 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecf2f4-b283-4b6a-8a08-aab819787ec4 service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:04.965846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecf2f4-b283-4b6a-8a08-aab819787ec4 service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:04.966130 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecf2f4-b283-4b6a-8a08-aab819787ec4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:04.968364 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-d6ecf2f4-b283-4b6a-8a08-aab819787ec4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:04.983328 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecf2f4-b283-4b6a-8a08-aab819787ec4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:04.984915 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecf2f4-b283-4b6a-8a08-aab819787ec4 service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:04.997300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1464/2875] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:36:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:36:06.866606 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82177979-b2a6-447e-92b0-f517b76b21b0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:06.880031 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82177979-b2a6-447e-92b0-f517b76b21b0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:06.883699 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a0063-23d3-4ae8-8fa6-355461cc0c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:06.884847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0063-23d3-4ae8-8fa6-355461cc0c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:06.885381 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0063-23d3-4ae8-8fa6-355461cc0c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:06.885875 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0063-23d3-4ae8-8fa6-355461cc0c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:06.888494 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bd9a0063-23d3-4ae8-8fa6-355461cc0c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:06.899786 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a0063-23d3-4ae8-8fa6-355461cc0c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:06.901490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a0063-23d3-4ae8-8fa6-355461cc0c71 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:06.912029 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1412/2876] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:36:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:36:14.991817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=32 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:16.907425 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=9 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:09.716727 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecf2f4-b283-4b6a-8a08-aab819787ec4 service placement] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:09.751278 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecf2f4-b283-4b6a-8a08-aab819787ec4 service placement] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:09.756143 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a0063-23d3-4ae8-8fa6-355461cc0c71 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:09.771833 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58747dfd-9094-49ed-a4ce-9fec1950c6c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:09.772227 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58747dfd-9094-49ed-a4ce-9fec1950c6c8 service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:09.772968 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58747dfd-9094-49ed-a4ce-9fec1950c6c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:09.773644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58747dfd-9094-49ed-a4ce-9fec1950c6c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:09.773805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a0063-23d3-4ae8-8fa6-355461cc0c71 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:09.779092 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-58747dfd-9094-49ed-a4ce-9fec1950c6c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:09.787430 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:09.791922 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:09.792939 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:09.794321 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] PATH_INFO: `/v3/users/004ddfdfeb7f4151bc84f166638123e4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:09.799849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=004ddfdfeb7f4151bc84f166638123e4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:09.805234 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:09.826484 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58747dfd-9094-49ed-a4ce-9fec1950c6c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:09.830758 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58747dfd-9094-49ed-a4ce-9fec1950c6c8 service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:09.866631 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1465/2877] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:37:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:37:09.939259 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004ddfdfeb7f4151bc84f166638123e4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:09.959342 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004ddfdfeb7f4151bc84f166638123e4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:09.960460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004ddfdfeb7f4151bc84f166638123e4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:09.995605 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004ddfdfeb7f4151bc84f166638123e4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:10.013988 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-aabc86be-8092-4ba3-994e-7c85007a55fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004ddfdfeb7f4151bc84f166638123e4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:10.027631 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1413/2878] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:37:09 2022] DELETE /identity/v3/users/004ddfdfeb7f4151bc84f166638123e4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:10.506232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58747dfd-9094-49ed-a4ce-9fec1950c6c8 service placement] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:10.532471 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58747dfd-9094-49ed-a4ce-9fec1950c6c8 service placement] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:10.636984 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:10.639151 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:10.639995 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:10.640551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] PATH_INFO: `/v3/projects/cc445d96f85d4cf49747bf592ad9d26b` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:10.642892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc445d96f85d4cf49747bf592ad9d26b)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:10.645403 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:10.721664 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc445d96f85d4cf49747bf592ad9d26b', 'request_id': 'req-03b181e3-754a-4021-aff4-0aea8d73e143'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:10.734352 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc445d96f85d4cf49747bf592ad9d26b', 'request_id': 'req-03b181e3-754a-4021-aff4-0aea8d73e143'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:10.748162 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc445d96f85d4cf49747bf592ad9d26b', 'request_id': 'req-03b181e3-754a-4021-aff4-0aea8d73e143'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:10.765066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] The token cache is being invalidate because project cc445d96f85d4cf49747bf592ad9d26b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:37:10.765494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:10.766393 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-03b181e3-754a-4021-aff4-0aea8d73e143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:10.768313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1466/2879] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:37:10 2022] DELETE /identity/v3/projects/cc445d96f85d4cf49747bf592ad9d26b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:10.775276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28413a-9ae7-47ca-8b6d-d325bbb50392 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:10.776861 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28413a-9ae7-47ca-8b6d-d325bbb50392 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:10.777853 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28413a-9ae7-47ca-8b6d-d325bbb50392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:10.810544 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ee28413a-9ae7-47ca-8b6d-d325bbb50392 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:10.812752 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ee28413a-9ae7-47ca-8b6d-d325bbb50392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:10.906362 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1414/2880] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:37:10.975450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cf973-c2c7-4227-a775-5f0594ffe18d None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:10.975760 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cf973-c2c7-4227-a775-5f0594ffe18d None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:10.975993 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cf973-c2c7-4227-a775-5f0594ffe18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:10.996158 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-513cf973-c2c7-4227-a775-5f0594ffe18d None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:10.997437 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-513cf973-c2c7-4227-a775-5f0594ffe18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:11.006345 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1467/2881] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:37:11.011047 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28413a-9ae7-47ca-8b6d-d325bbb50392 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:11.022351 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28413a-9ae7-47ca-8b6d-d325bbb50392 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:11.027824 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371e40-bd28-487f-b275-d475113acef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:11.028996 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371e40-bd28-487f-b275-d475113acef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:11.029545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371e40-bd28-487f-b275-d475113acef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:11.029935 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371e40-bd28-487f-b275-d475113acef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:11.030932 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c371e40-bd28-487f-b275-d475113acef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:37:11.031397 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c371e40-bd28-487f-b275-d475113acef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:11.033271 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c371e40-bd28-487f-b275-d475113acef7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:11.049816 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1415/2882] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 10:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:37:11.054168 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cf973-c2c7-4227-a775-5f0594ffe18d None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:11.064365 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cf973-c2c7-4227-a775-5f0594ffe18d None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:11.070929 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a9bc7-883d-46ab-921d-3a80afb21db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:11.072147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a9bc7-883d-46ab-921d-3a80afb21db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:11.072147 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a9bc7-883d-46ab-921d-3a80afb21db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:11.072454 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a9bc7-883d-46ab-921d-3a80afb21db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:11.073054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a9bc7-883d-46ab-921d-3a80afb21db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:11.075090 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a9bc7-883d-46ab-921d-3a80afb21db1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:11.124817 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1468/2883] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:37:11 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:37:11.129593 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371e40-bd28-487f-b275-d475113acef7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:11.151964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371e40-bd28-487f-b275-d475113acef7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:11.262002 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91f19-2be4-424a-9d33-9630f536321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:11.262944 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91f19-2be4-424a-9d33-9630f536321c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:11.263515 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91f19-2be4-424a-9d33-9630f536321c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:11.263890 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91f19-2be4-424a-9d33-9630f536321c admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:11.264708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad91f19-2be4-424a-9d33-9630f536321c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:11.267044 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad91f19-2be4-424a-9d33-9630f536321c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:11.275557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:11.307363 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1416/2884] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:37:11 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:37:11.308462 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a9bc7-883d-46ab-921d-3a80afb21db1 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:11.320144 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a9bc7-883d-46ab-921d-3a80afb21db1 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:11.325790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50728ceb-f894-4478-ad6d-85e70fe8af92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:11.326494 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50728ceb-f894-4478-ad6d-85e70fe8af92 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:11.326873 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50728ceb-f894-4478-ad6d-85e70fe8af92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:11.327080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50728ceb-f894-4478-ad6d-85e70fe8af92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:11.327839 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50728ceb-f894-4478-ad6d-85e70fe8af92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:11.329543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50728ceb-f894-4478-ad6d-85e70fe8af92 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:11.341812 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1469/2885] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:37:11.346200 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91f19-2be4-424a-9d33-9630f536321c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:11.357483 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91f19-2be4-424a-9d33-9630f536321c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:11.367392 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd86861-3747-4e06-9fb3-a5f64219ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:11.368374 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86861-3747-4e06-9fb3-a5f64219ae83 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:11.368807 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86861-3747-4e06-9fb3-a5f64219ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:11.369176 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86861-3747-4e06-9fb3-a5f64219ae83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:11.370043 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd86861-3747-4e06-9fb3-a5f64219ae83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:11.372063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd86861-3747-4e06-9fb3-a5f64219ae83 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:11.412963 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1417/2886] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:37:11.414478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50728ceb-f894-4478-ad6d-85e70fe8af92 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:11.429313 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50728ceb-f894-4478-ad6d-85e70fe8af92 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:11.439633 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a869-a2e3-4c41-bd9b-35ed6f7a97f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:11.441704 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a869-a2e3-4c41-bd9b-35ed6f7a97f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:11.443574 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a869-a2e3-4c41-bd9b-35ed6f7a97f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:11.443976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a869-a2e3-4c41-bd9b-35ed6f7a97f1 admin admin] PATH_INFO: `/v3/projects/d51887577477404e9595e11feff3da23/users/2bed25916e1a4c05a671992fe8f0d675/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:11.515468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a869-a2e3-4c41-bd9b-35ed6f7a97f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51887577477404e9595e11feff3da23, user_id=2bed25916e1a4c05a671992fe8f0d675, role_id=81ca5c3c0aaa4c8cb3c8eba1ce422232)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:11.527723 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a869-a2e3-4c41-bd9b-35ed6f7a97f1 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:11.571756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1470/2887] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:37:11 2022] PUT /identity/v3/projects/d51887577477404e9595e11feff3da23/users/2bed25916e1a4c05a671992fe8f0d675/roles/81ca5c3c0aaa4c8cb3c8eba1ce422232 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:11.576857 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afeaa2-9994-49b8-8cc4-988ddcc0d176 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:11.577872 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afeaa2-9994-49b8-8cc4-988ddcc0d176 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:11.578652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afeaa2-9994-49b8-8cc4-988ddcc0d176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:11.612025 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a8afeaa2-9994-49b8-8cc4-988ddcc0d176 None None] MFA Rules not processed for user `24f043f060e24197b7146fc46f2ee305`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:11.614269 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a8afeaa2-9994-49b8-8cc4-988ddcc0d176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:11.707268 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1418/2888] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:37:11.716845 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a869-a2e3-4c41-bd9b-35ed6f7a97f1 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:11.719765 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-1f73a869-a2e3-4c41-bd9b-35ed6f7a97f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:11.742236 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:11.802146 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a869-a2e3-4c41-bd9b-35ed6f7a97f1 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:11.807576 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40a606-0df6-47f2-8ea5-5ba9ab8c286a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:11.808275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40a606-0df6-47f2-8ea5-5ba9ab8c286a service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:11.808564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40a606-0df6-47f2-8ea5-5ba9ab8c286a service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:11.808844 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40a606-0df6-47f2-8ea5-5ba9ab8c286a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:11.819680 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40a606-0df6-47f2-8ea5-5ba9ab8c286a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:11.821189 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40a606-0df6-47f2-8ea5-5ba9ab8c286a service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:11.833185 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1471/2889] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:37:17.373989 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7855606-7eec-424c-9bba-0ba122c19808 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:17.374649 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7855606-7eec-424c-9bba-0ba122c19808 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:17.375003 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7855606-7eec-424c-9bba-0ba122c19808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:17.421130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c7855606-7eec-424c-9bba-0ba122c19808 None None] MFA Rules not processed for user `2bed25916e1a4c05a671992fe8f0d675`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:17.422849 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c7855606-7eec-424c-9bba-0ba122c19808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:17.527061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1419/2890] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:37:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:37:17.532366 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40a606-0df6-47f2-8ea5-5ba9ab8c286a service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:17.544177 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40a606-0df6-47f2-8ea5-5ba9ab8c286a service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:17.552489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2d5d-3a5e-4838-978b-74bd68cfebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:17.553697 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2d5d-3a5e-4838-978b-74bd68cfebda admin admin] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:17.554169 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2d5d-3a5e-4838-978b-74bd68cfebda admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:17.554644 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2d5d-3a5e-4838-978b-74bd68cfebda admin admin] PATH_INFO: `/v3/projects` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:17.556387 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f2d5d-3a5e-4838-978b-74bd68cfebda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:17.558733 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f2d5d-3a5e-4838-978b-74bd68cfebda admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:17.603678 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1472/2891] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 10:37:17 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:37:17.608152 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7855606-7eec-424c-9bba-0ba122c19808 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:17.622707 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7855606-7eec-424c-9bba-0ba122c19808 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:17.719457 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ae25c-e351-40e6-b2ba-e3aff53f9a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:17.720502 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ae25c-e351-40e6-b2ba-e3aff53f9a5f admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:17.720910 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ae25c-e351-40e6-b2ba-e3aff53f9a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:17.721337 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ae25c-e351-40e6-b2ba-e3aff53f9a5f admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:17.722759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ae25c-e351-40e6-b2ba-e3aff53f9a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:17.725043 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ae25c-e351-40e6-b2ba-e3aff53f9a5f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:17.745105 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:17.754205 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1420/2892] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 10:37:17 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:37:17.758767 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2d5d-3a5e-4838-978b-74bd68cfebda admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:17.785218 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2d5d-3a5e-4838-978b-74bd68cfebda admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:17.791214 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425c96-f675-445b-8b61-905c118660c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:17.791992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425c96-f675-445b-8b61-905c118660c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:17.792329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425c96-f675-445b-8b61-905c118660c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:17.792662 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425c96-f675-445b-8b61-905c118660c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:17.793648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38425c96-f675-445b-8b61-905c118660c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:17.795790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38425c96-f675-445b-8b61-905c118660c8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:17.808939 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1473/2893] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:37:17.814865 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ae25c-e351-40e6-b2ba-e3aff53f9a5f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:17.826788 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ae25c-e351-40e6-b2ba-e3aff53f9a5f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:17.832780 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbd32b-ea2d-4cde-bbdf-5e6ddae800f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:17.833749 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbd32b-ea2d-4cde-bbdf-5e6ddae800f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:17.834022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbd32b-ea2d-4cde-bbdf-5e6ddae800f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:17.834249 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbd32b-ea2d-4cde-bbdf-5e6ddae800f6 admin admin] PATH_INFO: `/v3/projects/43ed9896ce0944e09e6a7fcfd5e21d64/users/628c04d3ab3048f38d988f7d7dfe04ff/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:17.855119 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbd32b-ea2d-4cde-bbdf-5e6ddae800f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ed9896ce0944e09e6a7fcfd5e21d64, user_id=628c04d3ab3048f38d988f7d7dfe04ff, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:17.857915 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbd32b-ea2d-4cde-bbdf-5e6ddae800f6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:17.895899 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1421/2894] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:37:17 2022] PUT /identity/v3/projects/43ed9896ce0944e09e6a7fcfd5e21d64/users/628c04d3ab3048f38d988f7d7dfe04ff/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:17.902408 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425c96-f675-445b-8b61-905c118660c8 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:17.913823 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425c96-f675-445b-8b61-905c118660c8 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:17.993380 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f295f78-5e72-43e6-aaad-3fb836df3822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:17.994080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f295f78-5e72-43e6-aaad-3fb836df3822 admin admin] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:17.994367 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f295f78-5e72-43e6-aaad-3fb836df3822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:17.994996 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f295f78-5e72-43e6-aaad-3fb836df3822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:17.995616 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f295f78-5e72-43e6-aaad-3fb836df3822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:17.997284 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f295f78-5e72-43e6-aaad-3fb836df3822 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:18.009310 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1474/2895] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 10:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:37:18.014725 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbd32b-ea2d-4cde-bbdf-5e6ddae800f6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:18.039835 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbd32b-ea2d-4cde-bbdf-5e6ddae800f6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:18.049063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731db9-bdff-4cb8-aed2-0cfaadc4f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:18.049994 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731db9-bdff-4cb8-aed2-0cfaadc4f7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:18.050276 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731db9-bdff-4cb8-aed2-0cfaadc4f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:18.050604 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731db9-bdff-4cb8-aed2-0cfaadc4f7dc admin admin] PATH_INFO: `/v3/projects/43ed9896ce0944e09e6a7fcfd5e21d64/users/628c04d3ab3048f38d988f7d7dfe04ff/roles/914e2b45c35049e3a9cf63a7b7a4414b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:18.056795 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d731db9-bdff-4cb8-aed2-0cfaadc4f7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ed9896ce0944e09e6a7fcfd5e21d64, user_id=628c04d3ab3048f38d988f7d7dfe04ff, role_id=914e2b45c35049e3a9cf63a7b7a4414b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:18.061620 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d731db9-bdff-4cb8-aed2-0cfaadc4f7dc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:18.082066 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1422/2896] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 10:37:18 2022] PUT /identity/v3/projects/43ed9896ce0944e09e6a7fcfd5e21d64/users/628c04d3ab3048f38d988f7d7dfe04ff/roles/914e2b45c35049e3a9cf63a7b7a4414b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:18.433080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34864d8-a165-4e70-8f85-8519e5a2e896 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:18.433756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34864d8-a165-4e70-8f85-8519e5a2e896 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:18.434391 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34864d8-a165-4e70-8f85-8519e5a2e896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:18.658438 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-a34864d8-a165-4e70-8f85-8519e5a2e896 None None] MFA Rules not processed for user `7701ac0e772842e29e9e6903ff551a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:18.659870 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-a34864d8-a165-4e70-8f85-8519e5a2e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:18.761154 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:18.867355 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1475/2897] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 10:37:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:37:18.975573 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731db9-bdff-4cb8-aed2-0cfaadc4f7dc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:18.976937 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0d731db9-bdff-4cb8-aed2-0cfaadc4f7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:19.152252 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731db9-bdff-4cb8-aed2-0cfaadc4f7dc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:19.162583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431eb11-c681-49a9-be53-23a9c8d58daa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c07436108d4a2089a74e7891b849c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:19.163735 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431eb11-c681-49a9-be53-23a9c8d58daa service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:19.164237 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431eb11-c681-49a9-be53-23a9c8d58daa service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:19.164869 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431eb11-c681-49a9-be53-23a9c8d58daa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:19.187920 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431eb11-c681-49a9-be53-23a9c8d58daa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:19.191021 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431eb11-c681-49a9-be53-23a9c8d58daa service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:19.228226 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1423/2898] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 10:37:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:37:24.962196 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c691f14-4580-4ed1-a4ce-6338dc5bf99a None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:24.963770 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c691f14-4580-4ed1-a4ce-6338dc5bf99a None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:24.964197 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c691f14-4580-4ed1-a4ce-6338dc5bf99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:25.061008 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-9c691f14-4580-4ed1-a4ce-6338dc5bf99a None None] MFA Rules not processed for user `628c04d3ab3048f38d988f7d7dfe04ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:25.062330 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-9c691f14-4580-4ed1-a4ce-6338dc5bf99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:25.237080 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1476/2899] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:37:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:37:25.259895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431eb11-c681-49a9-be53-23a9c8d58daa service swift] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:25.268206 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2431eb11-c681-49a9-be53-23a9c8d58daa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:25.444490 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431eb11-c681-49a9-be53-23a9c8d58daa service swift] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:25.456559 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5a1d3-b28e-4230-bb22-776c0b1fdbe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:25.457953 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5a1d3-b28e-4230-bb22-776c0b1fdbe8 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:25.458651 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5a1d3-b28e-4230-bb22-776c0b1fdbe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:25.459275 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5a1d3-b28e-4230-bb22-776c0b1fdbe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:25.557705 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:25.635240 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5a1d3-b28e-4230-bb22-776c0b1fdbe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:25.636964 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5a1d3-b28e-4230-bb22-776c0b1fdbe8 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:25.652864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1424/2900] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:37:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:37:27.407593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05053855-21b2-4ccc-bb00-4545aba86d11 None None] REQUEST_METHOD: `POST` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:27.409300 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05053855-21b2-4ccc-bb00-4545aba86d11 None None] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:27.410124 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05053855-21b2-4ccc-bb00-4545aba86d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:27.448805 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.auth.core [None req-05053855-21b2-4ccc-bb00-4545aba86d11 None None] MFA Rules not processed for user `2bed25916e1a4c05a671992fe8f0d675`. Rule list: `[]` (Enabled: `True`). {{(pid=80160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:27.451528 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-05053855-21b2-4ccc-bb00-4545aba86d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:27.468976 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1477/2901] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 10:37:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:37:31.160479 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5a1d3-b28e-4230-bb22-776c0b1fdbe8 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:31.162743 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cfd5a1d3-b28e-4230-bb22-776c0b1fdbe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:31.313652 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5a1d3-b28e-4230-bb22-776c0b1fdbe8 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:31.323691 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:31.325380 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:31.326290 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:31.326866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] PATH_INFO: `/v3/users/172df9a596fd4729967f3787533ea57d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:31.329130 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=172df9a596fd4729967f3787533ea57d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:31.332090 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:31.399778 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '172df9a596fd4729967f3787533ea57d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:31.410767 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '172df9a596fd4729967f3787533ea57d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:31.411704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '172df9a596fd4729967f3787533ea57d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:31.434970 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '172df9a596fd4729967f3787533ea57d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:31.448366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '172df9a596fd4729967f3787533ea57d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:31.456471 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1425/2902] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:37:31 2022] DELETE /identity/v3/users/172df9a596fd4729967f3787533ea57d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:31.709575 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05053855-21b2-4ccc-bb00-4545aba86d11 None None] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:31.731681 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05053855-21b2-4ccc-bb00-4545aba86d11 None None] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:31.838791 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:31.840628 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:31.841404 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:31.842089 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] PATH_INFO: `/v3/projects/0ead3712348245f8862718ef0e30b3c0` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:31.844578 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ead3712348245f8862718ef0e30b3c0)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:31.848361 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:31.933860 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ead3712348245f8862718ef0e30b3c0', 'request_id': 'req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:31.947354 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ead3712348245f8862718ef0e30b3c0', 'request_id': 'req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:31.957571 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ead3712348245f8862718ef0e30b3c0', 'request_id': 'req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:31.961271 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:31.984201 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] The token cache is being invalidate because project 0ead3712348245f8862718ef0e30b3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:37:31.984761 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:31.985960 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:31.990564 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1478/2903] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:37:31 2022] DELETE /identity/v3/projects/0ead3712348245f8862718ef0e30b3c0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:31.994484 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:31.996477 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:32.019866 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b2ab0-49f9-46da-a127-de0dfb1ee0ef admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:32.100833 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:32.129022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:32.130800 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:32.131400 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:32.131959 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] PATH_INFO: `/v3/users/da84bf4296db4bcb8c524675ba377f44` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:32.136892 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da84bf4296db4bcb8c524675ba377f44)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:32.143668 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:32.224952 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da84bf4296db4bcb8c524675ba377f44'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:32.235583 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da84bf4296db4bcb8c524675ba377f44'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:32.236542 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da84bf4296db4bcb8c524675ba377f44'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:32.259574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da84bf4296db4bcb8c524675ba377f44'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:32.272468 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da84bf4296db4bcb8c524675ba377f44'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:32.281398 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1426/2904] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:37:31 2022] DELETE /identity/v3/users/da84bf4296db4bcb8c524675ba377f44 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:32.569009 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:32.575091 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:32.596450 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccfdb4-140f-4e38-8b6d-2ce4cd1710a8 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:32.695740 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:32.696669 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:32.696953 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:32.697232 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] PATH_INFO: `/v3/projects/6a265bf2351b4ddd98824cec4b8cd810` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:32.698679 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a265bf2351b4ddd98824cec4b8cd810)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:32.700750 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:32.758816 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a265bf2351b4ddd98824cec4b8cd810', 'request_id': 'req-30a0bec6-5477-436d-bc4c-bf2de571fa9e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:32.768652 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a265bf2351b4ddd98824cec4b8cd810', 'request_id': 'req-30a0bec6-5477-436d-bc4c-bf2de571fa9e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:32.777691 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a265bf2351b4ddd98824cec4b8cd810', 'request_id': 'req-30a0bec6-5477-436d-bc4c-bf2de571fa9e'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:32.792054 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] The token cache is being invalidate because project 6a265bf2351b4ddd98824cec4b8cd810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:37:32.792394 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:32.793237 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:32.795014 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1479/2905] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:37:32 2022] DELETE /identity/v3/projects/6a265bf2351b4ddd98824cec4b8cd810 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:42.276074 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:42.788077 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=54,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:38:05.998903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:38:06.000715 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:38:06.109061 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fb815-9cb9-4086-ae43-59bf3e644f63 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:38:06.188493 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a97d-0029-4311-a3fc-a8c2bdbce7ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:38:06.189178 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a97d-0029-4311-a3fc-a8c2bdbce7ec service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:38:06.189460 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a97d-0029-4311-a3fc-a8c2bdbce7ec service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:38:06.189734 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a97d-0029-4311-a3fc-a8c2bdbce7ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:38:06.191817 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-92f4a97d-0029-4311-a3fc-a8c2bdbce7ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:38:06.205366 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4a97d-0029-4311-a3fc-a8c2bdbce7ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:38:06.207082 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4a97d-0029-4311-a3fc-a8c2bdbce7ec service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:38:06.229930 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1427/2906] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:38:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:38:09.103150 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:38:09.104957 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:38:09.177114 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0bec6-5477-436d-bc4c-bf2de571fa9e admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:38:09.181472 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b6269-1afd-4b3c-b52c-f5a22e7cc2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:38:09.182648 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b6269-1afd-4b3c-b52c-f5a22e7cc2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:38:09.182954 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b6269-1afd-4b3c-b52c-f5a22e7cc2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:38:09.183384 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b6269-1afd-4b3c-b52c-f5a22e7cc2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:38:09.186219 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e76b6269-1afd-4b3c-b52c-f5a22e7cc2a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:38:09.271264 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b6269-1afd-4b3c-b52c-f5a22e7cc2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:38:09.272776 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b6269-1afd-4b3c-b52c-f5a22e7cc2a7 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:38:09.284916 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1480/2907] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:38:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:38:11.469033 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a97d-0029-4311-a3fc-a8c2bdbce7ec service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:38:11.470965 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-92f4a97d-0029-4311-a3fc-a8c2bdbce7ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:38:11.493052 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a97d-0029-4311-a3fc-a8c2bdbce7ec service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:38:11.501693 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b892b9-a8f7-4e89-8588-291d1f02a677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:38:11.502648 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b892b9-a8f7-4e89-8588-291d1f02a677 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:38:11.503121 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b892b9-a8f7-4e89-8588-291d1f02a677 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:38:11.503574 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b892b9-a8f7-4e89-8588-291d1f02a677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:38:11.507481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-78b892b9-a8f7-4e89-8588-291d1f02a677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:38:11.526141 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b892b9-a8f7-4e89-8588-291d1f02a677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:38:11.529518 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b892b9-a8f7-4e89-8588-291d1f02a677 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:38:11.551131 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1428/2908] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:38:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:38:19.279561 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=50 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:38:21.541640 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=68 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:38:49.095422 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b6269-1afd-4b3c-b52c-f5a22e7cc2a7 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:38:49.097093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e76b6269-1afd-4b3c-b52c-f5a22e7cc2a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:38:49.186483 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b6269-1afd-4b3c-b52c-f5a22e7cc2a7 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:38:49.192588 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126272-47fc-445a-b285-e4f32f79a63f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:38:49.193279 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126272-47fc-445a-b285-e4f32f79a63f service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:38:49.193567 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126272-47fc-445a-b285-e4f32f79a63f service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:38:49.193852 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126272-47fc-445a-b285-e4f32f79a63f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:38:49.195936 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-23126272-47fc-445a-b285-e4f32f79a63f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:38:49.210098 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23126272-47fc-445a-b285-e4f32f79a63f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:38:49.211891 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23126272-47fc-445a-b285-e4f32f79a63f service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:38:49.224449 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1481/2909] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:38:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:38:59.218874 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=32 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:40:34.015059 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b892b9-a8f7-4e89-8588-291d1f02a677 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:40:34.016704 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-78b892b9-a8f7-4e89-8588-291d1f02a677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:40:34.031099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b892b9-a8f7-4e89-8588-291d1f02a677 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:40:34.036157 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e80df8-d5af-4485-b475-f1bf8b83f100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:40:34.036781 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e80df8-d5af-4485-b475-f1bf8b83f100 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:40:34.037101 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e80df8-d5af-4485-b475-f1bf8b83f100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:40:34.037418 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e80df8-d5af-4485-b475-f1bf8b83f100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:40:34.039764 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-77e80df8-d5af-4485-b475-f1bf8b83f100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:40:34.056388 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e80df8-d5af-4485-b475-f1bf8b83f100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:40:34.057864 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e80df8-d5af-4485-b475-f1bf8b83f100 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:40:34.071411 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1429/2910] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:40:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:40:35.292377 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126272-47fc-445a-b285-e4f32f79a63f service placement] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:40:35.309807 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126272-47fc-445a-b285-e4f32f79a63f service placement] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:40:35.316329 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d13e47-e7f6-4064-b78e-09fbc29e2764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:40:35.317536 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d13e47-e7f6-4064-b78e-09fbc29e2764 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:40:35.318035 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d13e47-e7f6-4064-b78e-09fbc29e2764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:40:35.318551 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d13e47-e7f6-4064-b78e-09fbc29e2764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:40:35.321819 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-e3d13e47-e7f6-4064-b78e-09fbc29e2764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:40:35.347059 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d13e47-e7f6-4064-b78e-09fbc29e2764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:40:35.349899 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d13e47-e7f6-4064-b78e-09fbc29e2764 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:40:35.372491 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1482/2911] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:40:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:40:44.035808 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e80df8-d5af-4485-b475-f1bf8b83f100 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:40:44.045999 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e80df8-d5af-4485-b475-f1bf8b83f100 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:40:44.050545 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf8f0-4041-43c4-a147-bd304fc06994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:40:44.051241 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf8f0-4041-43c4-a147-bd304fc06994 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:40:44.051529 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf8f0-4041-43c4-a147-bd304fc06994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:40:44.051799 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf8f0-4041-43c4-a147-bd304fc06994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:40:44.054071 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-24daf8f0-4041-43c4-a147-bd304fc06994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:40:44.068099 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24daf8f0-4041-43c4-a147-bd304fc06994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:40:44.070958 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24daf8f0-4041-43c4-a147-bd304fc06994 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:40:44.087569 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1430/2912] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:40:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:40:44.203400 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d13e47-e7f6-4064-b78e-09fbc29e2764 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:40:44.214248 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d13e47-e7f6-4064-b78e-09fbc29e2764 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:40:44.219997 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834dc59-af93-42c3-840a-461ddee421d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:40:44.221228 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834dc59-af93-42c3-840a-461ddee421d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:40:44.221720 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834dc59-af93-42c3-840a-461ddee421d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:40:44.222202 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834dc59-af93-42c3-840a-461ddee421d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:40:44.225708 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-8834dc59-af93-42c3-840a-461ddee421d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:40:44.244346 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834dc59-af93-42c3-840a-461ddee421d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:40:44.246489 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834dc59-af93-42c3-840a-461ddee421d6 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:40:44.257301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1483/2913] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:40:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:40:44.380805 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf8f0-4041-43c4-a147-bd304fc06994 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:40:44.391255 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf8f0-4041-43c4-a147-bd304fc06994 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:40:44.395889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b11b5-e24e-49be-9981-1d65fbb82e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:40:44.396570 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b11b5-e24e-49be-9981-1d65fbb82e0c service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:40:44.396852 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b11b5-e24e-49be-9981-1d65fbb82e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:40:44.397305 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b11b5-e24e-49be-9981-1d65fbb82e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:40:44.399532 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-686b11b5-e24e-49be-9981-1d65fbb82e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:40:44.416115 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b11b5-e24e-49be-9981-1d65fbb82e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:40:44.417598 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b11b5-e24e-49be-9981-1d65fbb82e0c service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:40:44.430661 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1431/2914] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:40:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:40:54.253148 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=12 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:40:54.424667 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=18 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:41:55.793609 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834dc59-af93-42c3-840a-461ddee421d6 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:41:55.803965 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834dc59-af93-42c3-840a-461ddee421d6 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:41:55.808543 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e5e4f-4320-4dcb-bcfd-af29ad31d4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:41:55.809360 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e5e4f-4320-4dcb-bcfd-af29ad31d4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:41:55.809695 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e5e4f-4320-4dcb-bcfd-af29ad31d4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:41:55.810046 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e5e4f-4320-4dcb-bcfd-af29ad31d4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:41:55.812323 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-cd4e5e4f-4320-4dcb-bcfd-af29ad31d4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:41:55.824756 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e5e4f-4320-4dcb-bcfd-af29ad31d4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:41:55.826291 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e5e4f-4320-4dcb-bcfd-af29ad31d4b8 service neutron] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:41:55.837093 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1484/2915] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:41:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:42:05.831945 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=6 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:42:25.421871 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b11b5-e24e-49be-9981-1d65fbb82e0c service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:42:25.424528 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-686b11b5-e24e-49be-9981-1d65fbb82e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:42:25.448361 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b11b5-e24e-49be-9981-1d65fbb82e0c service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:42:25.458063 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eba7b-657b-4df5-b574-6a6627f20180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:42:25.459197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eba7b-657b-4df5-b574-6a6627f20180 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:42:25.459694 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eba7b-657b-4df5-b574-6a6627f20180 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:42:25.460324 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eba7b-657b-4df5-b574-6a6627f20180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:42:25.463562 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8d0eba7b-657b-4df5-b574-6a6627f20180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:42:25.566585 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eba7b-657b-4df5-b574-6a6627f20180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:42:25.568591 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eba7b-657b-4df5-b574-6a6627f20180 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:42:25.582020 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1432/2916] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:42:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:42:27.962886 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e5e4f-4320-4dcb-bcfd-af29ad31d4b8 service neutron] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:42:27.984139 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e5e4f-4320-4dcb-bcfd-af29ad31d4b8 service neutron] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:42:27.992110 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f437-c7f1-4781-843b-7a0f3bbf50bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f91c2e9ae8844d9181aff785c02cf3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:42:27.992958 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f437-c7f1-4781-843b-7a0f3bbf50bb service nova] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:42:27.993481 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f437-c7f1-4781-843b-7a0f3bbf50bb service nova] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:42:27.993928 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f437-c7f1-4781-843b-7a0f3bbf50bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:42:27.997405 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-55c1f437-c7f1-4781-843b-7a0f3bbf50bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:42:28.018790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1f437-c7f1-4781-843b-7a0f3bbf50bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:42:28.021627 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1f437-c7f1-4781-843b-7a0f3bbf50bb service nova] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:42:28.037160 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1485/2917] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:42:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:42:30.947759 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eba7b-657b-4df5-b574-6a6627f20180 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:42:30.959995 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eba7b-657b-4df5-b574-6a6627f20180 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:42:30.966629 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e83477-7dee-4e59-a97f-b914fee9002f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0afeafd76edb40289d715f81485fa7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:42:30.967708 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83477-7dee-4e59-a97f-b914fee9002f service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:42:30.968197 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83477-7dee-4e59-a97f-b914fee9002f service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:42:30.968677 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83477-7dee-4e59-a97f-b914fee9002f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:42:30.971889 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e9e83477-7dee-4e59-a97f-b914fee9002f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:42:31.088444 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e83477-7dee-4e59-a97f-b914fee9002f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:42:31.090557 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e83477-7dee-4e59-a97f-b914fee9002f service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:42:31.102943 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1433/2918] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:42:34.991790 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f437-c7f1-4781-843b-7a0f3bbf50bb service nova] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:42:35.010066 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f437-c7f1-4781-843b-7a0f3bbf50bb service nova] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:42:35.020619 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da3999-7b77-4b51-a4fb-adea64947156 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:42:35.021992 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da3999-7b77-4b51-a4fb-adea64947156 service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:42:35.022684 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da3999-7b77-4b51-a4fb-adea64947156 service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:42:35.023326 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da3999-7b77-4b51-a4fb-adea64947156 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:42:35.027212 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c9da3999-7b77-4b51-a4fb-adea64947156 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:42:35.051835 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da3999-7b77-4b51-a4fb-adea64947156 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:42:35.055468 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da3999-7b77-4b51-a4fb-adea64947156 service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:42:35.082707 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1486/2919] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:42:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:42:39.243870 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e83477-7dee-4e59-a97f-b914fee9002f service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:42:39.279983 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e83477-7dee-4e59-a97f-b914fee9002f service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:42:39.287144 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c18e19-291c-4502-a078-db5e34a8cf61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:42:39.288022 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c18e19-291c-4502-a078-db5e34a8cf61 service placement] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:42:39.288552 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c18e19-291c-4502-a078-db5e34a8cf61 service placement] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:42:39.288903 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c18e19-291c-4502-a078-db5e34a8cf61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:42:39.291538 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d6c18e19-291c-4502-a078-db5e34a8cf61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:42:39.310385 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c18e19-291c-4502-a078-db5e34a8cf61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:42:39.312253 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c18e19-291c-4502-a078-db5e34a8cf61 service placement] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:42:39.321103 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da3999-7b77-4b51-a4fb-adea64947156 service placement] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:42:39.323798 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-c9da3999-7b77-4b51-a4fb-adea64947156 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:42:39.325431 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1434/2920] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:42:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:42:39.347546 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da3999-7b77-4b51-a4fb-adea64947156 service placement] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:42:39.356612 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:42:39.358485 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:42:39.359132 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:42:39.359630 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] PATH_INFO: `/v3/users/2bed25916e1a4c05a671992fe8f0d675` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:42:39.362082 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bed25916e1a4c05a671992fe8f0d675)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:42:39.365948 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:42:39.448754 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bed25916e1a4c05a671992fe8f0d675'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:39.449478 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bed25916e1a4c05a671992fe8f0d675'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:39.450190 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bed25916e1a4c05a671992fe8f0d675'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:39.466131 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bed25916e1a4c05a671992fe8f0d675'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:39.476317 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bed25916e1a4c05a671992fe8f0d675'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:39.497395 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1487/2921] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:42:39 2022] DELETE /identity/v3/users/2bed25916e1a4c05a671992fe8f0d675 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:42:39.712656 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c18e19-291c-4502-a078-db5e34a8cf61 service placement] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:42:39.735746 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c18e19-291c-4502-a078-db5e34a8cf61 service placement] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:42:39.818081 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:42:39.819032 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:42:39.819318 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:42:39.819619 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] PATH_INFO: `/v3/projects/d51887577477404e9595e11feff3da23` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:42:39.820913 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51887577477404e9595e11feff3da23)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:42:39.822972 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:42:39.850265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:42:39.881442 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51887577477404e9595e11feff3da23', 'request_id': 'req-b8206933-6061-4657-af67-2eed5105bc99'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:39.888757 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51887577477404e9595e11feff3da23', 'request_id': 'req-b8206933-6061-4657-af67-2eed5105bc99'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:39.898738 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51887577477404e9595e11feff3da23', 'request_id': 'req-b8206933-6061-4657-af67-2eed5105bc99'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:39.913196 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] The token cache is being invalidate because project d51887577477404e9595e11feff3da23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:42:39.913481 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:39.914183 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:39.915895 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1435/2922] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:42:39 2022] DELETE /identity/v3/projects/d51887577477404e9595e11feff3da23 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:42:39.920593 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:42:39.923125 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:42:39.941801 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4aad6-18be-455b-bc0f-72d93bac603a admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:42:40.017173 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:42:40.017998 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:42:40.018285 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:42:40.018610 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] PATH_INFO: `/v3/users/628c04d3ab3048f38d988f7d7dfe04ff` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:42:40.020007 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=628c04d3ab3048f38d988f7d7dfe04ff)` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:42:40.022033 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:42:40.082347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '628c04d3ab3048f38d988f7d7dfe04ff'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:40.083121 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '628c04d3ab3048f38d988f7d7dfe04ff'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:40.083784 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '628c04d3ab3048f38d988f7d7dfe04ff'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:40.085502 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:42:40.103502 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '628c04d3ab3048f38d988f7d7dfe04ff'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:40.114275 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.notifications [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '628c04d3ab3048f38d988f7d7dfe04ff'} {{(pid=80160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:40.129700 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1488/2923] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 10:42:39 2022] DELETE /identity/v3/users/628c04d3ab3048f38d988f7d7dfe04ff => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:42:40.347231 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:42:40.349389 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:42:40.367844 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8206933-6061-4657-af67-2eed5105bc99 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:42:40.445470 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f043f060e24197b7146fc46f2ee305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5250969aacd849649f4438fde7d1550d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:42:40.446424 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:42:40.446790 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:42:40.447109 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] PATH_INFO: `/v3/projects/43ed9896ce0944e09e6a7fcfd5e21d64` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:42:40.448606 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ed9896ce0944e09e6a7fcfd5e21d64)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:42:40.450713 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:42:40.517265 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ed9896ce0944e09e6a7fcfd5e21d64', 'request_id': 'req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:40.524120 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ed9896ce0944e09e6a7fcfd5e21d64', 'request_id': 'req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:40.534006 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ed9896ce0944e09e6a7fcfd5e21d64', 'request_id': 'req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:40.548111 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] The token cache is being invalidate because project 43ed9896ce0944e09e6a7fcfd5e21d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:42:40.548464 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:40.549088 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-869c1cef-8f45-42cd-985b-23d4c8b9c9b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:42:40.550847 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1436/2924] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 10:42:40 2022] DELETE /identity/v3/projects/43ed9896ce0944e09e6a7fcfd5e21d64 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:42:50.125370 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:42:50.544623 dv-cinder-847132-1-iscsi devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:43:54.050811 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] Authenticating user token {{(pid=80160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:43:54.052676 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:43:54.220159 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a8771-e6a4-4761-bbcb-bdc0ed664675 admin admin] Validating token access rules against request {{(pid=80160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:43:54.287113 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6b592-b711-4ee9-a95a-212e4a494b5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b257dee0ca3400f860ef9bd8c7a4e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53153b511330427b9325ae63396dd6f5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:43:54.287793 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6b592-b711-4ee9-a95a-212e4a494b5d service placement] REQUEST_METHOD: `GET` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:43:54.288075 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6b592-b711-4ee9-a95a-212e4a494b5d service placement] SCRIPT_NAME: `/identity` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:43:54.288347 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6b592-b711-4ee9-a95a-212e4a494b5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:43:54.290301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.fernet_utils [None req-5cc6b592-b711-4ee9-a95a-212e4a494b5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:43:54.303333 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6b592-b711-4ee9-a95a-212e4a494b5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:43:54.304892 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6b592-b711-4ee9-a95a-212e4a494b5d service placement] RBAC: Authorization granted {{(pid=80160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:43:54.316846 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: [pid: 80160|app: 0|req: 1489/2925] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 10:43:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:44:04.311301 dv-cinder-847132-1-iscsi devstack@keystone.service[80160]: DEBUG dbcounter [-] [80160] Writing DB stats keystone:SELECT=89 {{(pid=80160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}